-- Logs begin at Mon 2022-06-06 11:21:48 UTC, end at Mon 2022-06-06 12:27:13 UTC. -- Jun 06 11:54:56.079249 dv-cinder-825492-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 11:54:56.088358 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 11:54:56 2022] *** Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: nodename: dv-cinder-825492-20-iscsi Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: machine: x86_64 Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: clock source: unix Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: pcre jit disabled Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: detected number of CPU cores: 4 Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: current working directory: / Jun 06 11:54:56.090328 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: detected binary path: /usr/bin/uwsgi-core Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: your processes number limit is 47680 Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: your memory page size is 4096 bytes Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: detected max file descriptor number: 2048 Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: lock engine: pthread robust mutexes Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: thunder lock: enabled Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 11:54:56.090948 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 11:54:56.134959 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: Python main interpreter initialized at 0x560f2ddd29c0 Jun 06 11:54:56.134959 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: python threads support enabled Jun 06 11:54:56.134959 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: your server socket listen backlog is limited to 100 connections Jun 06 11:54:56.134959 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: your mercy for graceful operations on workers is 90 seconds Jun 06 11:54:56.135290 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 11:54:56.135366 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: *** Operational MODE: preforking *** Jun 06 11:54:56.135623 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: *** uWSGI is running in multiple interpreter mode *** Jun 06 11:54:56.135623 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: spawned uWSGI master process (pid: 103023) Jun 06 11:54:56.135804 dv-cinder-825492-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 11:54:56.136627 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: spawned uWSGI worker 1 (pid: 103024, cores: 1) Jun 06 11:54:56.136728 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: spawned uWSGI worker 2 (pid: 103025, cores: 1) Jun 06 11:54:56.137256 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 11:54:57.354100 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 11:54:57.362444 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 11:54:58.074546 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 11:54:58.074546 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 06 11:54:58.074880 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 11:54:58.074880 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes Jun 06 11:54:58.077158 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 11:54:58.077158 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: from cryptography.utils import int_from_bytes Jun 06 11:54:58.077496 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 11:54:58.077496 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: from cryptography.utils import int_from_bytes Jun 06 11:55:00.628170 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 11:55:00.628735 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 11:55:00.628926 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 11:55:00.629287 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 11:55:00.629544 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 11:55:00.629930 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.630252 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.630571 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.630915 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.631247 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.631556 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.631871 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.632204 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.632511 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.632769 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.633086 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.633407 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-20-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.634407 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.634752 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.635089 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.635411 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.635717 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.636039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.636344 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.636841 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.637279 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.637589 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.637782 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 11:55:00.638161 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.638252 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 11:55:00.638321 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.638517 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.638619 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 11:55:00.638823 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.638968 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 11:55:00.639149 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 11:55:00.639235 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.639456 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.639554 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.639776 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.639874 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640084 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640173 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640443 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640558 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-20-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640764 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.640850 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641072 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641187 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641381 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641483 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641692 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.641774 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642017 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642114 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642276 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642381 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642587 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642687 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.642939 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-20-iscsi {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643050 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643257 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643344 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643561 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643648 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643874 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.643972 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644208 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644349 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644490 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644575 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644803 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.644907 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645100 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645184 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645404 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645605 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645724 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.645915 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646015 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646218 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646311 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646524 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646607 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646828 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.646937 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647167 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647262 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647469 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647786 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.647870 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648034 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648128 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648283 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648400 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648600 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648707 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.648917 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.649098 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-20-iscsi {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.649270 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.649962 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650062 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650277 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650362 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650589 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650673 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.650975 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651151 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651281 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651375 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651584 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651672 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651886 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.651973 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652201 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652288 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652503 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652585 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652817 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.652900 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653128 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653222 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653439 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653525 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653760 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.653846 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654058 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654142 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654360 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654443 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654664 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.654748 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655004 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655103 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655306 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655402 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655608 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655694 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655856 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.655942 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656159 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656252 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656474 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656559 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656788 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.656881 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657102 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657202 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657354 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657441 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657603 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657700 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.657916 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658003 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658230 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658314 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658532 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658617 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658851 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.658937 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659160 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659254 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659462 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659558 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659763 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.659847 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660057 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660139 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660360 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660459 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660658 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660743 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.660959 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661052 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661260 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661352 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661562 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661649 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661863 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.661947 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662164 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662261 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662465 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662551 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662767 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.662906 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663108 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663202 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663421 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663510 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663724 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.663809 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664026 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664112 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664326 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664419 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664628 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664715 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.664959 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665056 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665259 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665354 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665560 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665653 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665875 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.665967 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666175 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666260 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666478 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666562 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666726 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.666811 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667052 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667137 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667354 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667438 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667671 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667758 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.667975 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668069 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668275 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668365 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668574 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668659 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668872 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.668965 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669172 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669267 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669471 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669555 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669769 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.669852 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670070 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670161 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670369 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670463 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670667 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670758 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.670990 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671089 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671288 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671374 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671587 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671715 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671899 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.671994 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672199 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672289 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672501 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672587 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672798 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.672895 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.673105 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.673191 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.673407 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.673493 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.673721 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.673814 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.674022 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.674107 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.674324 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.674408 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.674639 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.674731 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.674968 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.675056 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.675272 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.675360 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.675585 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.675671 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.675886 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.675977 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.676186 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.676272 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.676500 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.676586 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.676798 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.676891 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.677099 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.677183 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.677410 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.677504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.677710 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.677795 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.678012 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.678104 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.678310 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.678396 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.678609 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.678700 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.678936 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.679036 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.679238 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.679330 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.679535 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.679620 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.679834 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.679935 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.680128 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.680220 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.680461 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.680557 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.680779 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.680873 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.681085 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.681303 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.681387 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.681622 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.681714 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.681949 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.682048 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 11:55:00.682271 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.682378 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.682585 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.682672 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.682920 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683010 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683238 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683323 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683564 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683897 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.683982 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684209 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684294 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684516 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684607 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684827 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.684912 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685137 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685259 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685443 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685537 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685751 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.685837 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686056 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686147 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686369 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686464 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686681 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.686766 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687019 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687116 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687332 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687419 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687642 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687726 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.687950 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688033 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688255 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688348 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688560 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688643 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688862 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.688949 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689165 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689264 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689466 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689551 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689772 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.689856 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690072 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690159 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690391 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690715 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.690808 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691042 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691127 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691351 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691436 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691661 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691758 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.691967 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692050 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692276 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692368 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692582 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692675 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.692886 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693015 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693199 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693284 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693502 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693609 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693800 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.693884 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694105 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694189 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694411 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694498 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694711 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.694832 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695056 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695142 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695360 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695455 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695661 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695753 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.695968 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.696606 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.696896 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.696987 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697210 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697308 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697515 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697601 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697823 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.697910 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698127 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698219 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698430 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698515 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698732 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.698818 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699062 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699148 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699366 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699462 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699686 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.699772 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700009 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700094 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700313 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700473 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700644 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700736 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.700948 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701033 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701256 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701348 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701560 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701653 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701863 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.701947 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702164 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702259 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702469 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702560 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702769 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.702870 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703100 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703192 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703401 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703485 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703710 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.703795 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704011 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704095 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704327 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704412 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704630 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704716 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.704929 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705013 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705231 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705316 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705532 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705618 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705835 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.705921 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706142 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706227 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706449 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706543 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706768 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.706887 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707105 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707190 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707415 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707513 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707729 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.707821 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708044 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708136 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708347 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708443 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708653 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708737 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.708961 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709046 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709268 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709361 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709567 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709658 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709874 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.709968 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710175 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710261 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710561 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710777 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.710895 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.711106 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.711194 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.711407 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.711493 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.711752 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.712393 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.712597 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.712700 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.712933 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713115 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713266 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713427 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713581 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713750 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.713905 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714058 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714212 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714362 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714525 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714832 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.714990 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715161 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715329 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715468 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715633 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715777 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.715970 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716093 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716301 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716388 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716615 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716702 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.716933 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717018 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717242 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717336 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717554 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717639 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717862 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.717955 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718168 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718261 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718475 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718559 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718779 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.718895 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719137 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719230 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719444 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719536 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719754 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.719848 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720059 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720151 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720372 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720456 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720677 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720771 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.720983 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721066 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721282 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721366 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721583 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721676 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721892 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.721977 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722204 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722290 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722513 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722599 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722818 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.722956 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723145 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723230 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723454 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723540 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723760 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.723845 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724061 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724151 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724362 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724458 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724756 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.724980 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725285 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725370 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725598 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725735 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725905 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.725999 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726222 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726305 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726523 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726606 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726855 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.726955 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.727159 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.727244 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.727503 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.727635 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.727810 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728105 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728204 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728440 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728532 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728746 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.728831 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729049 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729181 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729363 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729448 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729671 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729834 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.729977 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.730062 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.730552 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.730636 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.730882 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.730985 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731184 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731269 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731490 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731576 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731799 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.731894 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732103 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732187 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732409 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732496 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732711 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.732806 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733016 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733101 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733320 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733447 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733620 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733707 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.733918 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734005 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734224 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734307 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734531 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734618 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734834 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.734973 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.735163 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.735289 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.735479 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.735566 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.735778 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736045 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736132 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736374 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736471 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736678 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736762 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.736979 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737072 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737279 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737372 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737578 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737664 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.737909 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738000 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738212 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738298 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738513 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738597 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738825 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.738947 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739166 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739263 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739469 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739555 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739770 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.739855 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740074 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740167 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740373 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740460 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740675 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740761 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.740977 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741070 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741280 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741373 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741576 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741660 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741877 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.741978 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742175 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742262 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742562 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742785 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.742889 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743140 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743228 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743536 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743755 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.743842 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744075 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744168 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744382 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744467 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744681 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744767 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.744982 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745258 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745395 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745592 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745687 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745892 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.745977 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746214 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746298 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746533 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746656 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746887 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.746993 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747185 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747270 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747491 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747578 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747810 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.747902 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748112 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748207 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748416 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748519 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748717 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.748810 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749017 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749102 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749317 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749410 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749618 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749703 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.749921 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750006 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750223 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750320 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750528 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750622 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750828 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.750931 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751149 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751235 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751446 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751530 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751746 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.751831 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752054 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752151 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752356 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752441 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752654 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752745 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.752955 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753044 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753262 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753347 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753566 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753658 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753866 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.753952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754164 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754248 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754461 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754544 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754774 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.754917 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755103 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755199 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755405 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755499 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755708 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.755794 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756014 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756100 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756321 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756418 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756622 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.756940 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757024 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757241 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757335 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757540 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757623 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757836 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.757919 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.758140 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.758225 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.758442 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.758526 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.759294 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.759404 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.759601 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.759752 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.759920 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760063 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760234 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760372 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760535 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760680 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760840 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.760981 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761286 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761439 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761589 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761739 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.761899 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762042 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762203 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762339 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762503 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762636 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762802 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.762957 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763140 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763258 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763445 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763557 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763746 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.763873 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764053 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764182 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764353 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764481 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764782 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.764966 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765081 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765267 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765419 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765569 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765719 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.765875 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766072 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766168 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766375 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766467 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766685 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.766778 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767026 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767114 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767337 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767422 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767643 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767731 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.767951 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768038 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768248 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768334 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768549 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768643 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768851 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.768937 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769158 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769249 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769460 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769547 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769758 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.769855 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770063 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770157 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770364 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770448 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770757 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.770987 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771088 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771292 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771378 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771591 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771677 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771887 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.771982 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772183 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772276 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772484 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772570 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772782 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.772881 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773086 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773170 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773392 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773690 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773819 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.773991 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774077 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774335 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774459 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774675 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774899 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.774988 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775103 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775338 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775436 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775640 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775727 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.775952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776037 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776266 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776358 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776573 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776659 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776877 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.776970 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777183 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777275 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777481 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777564 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777779 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.777862 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778082 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778175 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778383 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778467 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778681 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.778806 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779013 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779333 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779449 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779638 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779753 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.779943 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780260 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780377 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780580 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780693 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780901 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.780988 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.781202 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.781289 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.781508 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.781695 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.781814 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782004 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782117 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782311 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782423 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782619 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782784 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.782947 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783035 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783250 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783336 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783558 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783656 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783886 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.783978 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784189 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784274 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784493 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784586 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784794 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.784880 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785097 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785183 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785402 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785489 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785717 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.785799 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786024 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786130 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786326 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786439 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786631 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786723 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.786955 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787178 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787317 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787488 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787573 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787795 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.787959 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788116 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788269 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788434 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788576 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788754 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.788880 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.789056 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.789191 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.789366 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.789500 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.789672 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.790435 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.790676 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.790762 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.790829 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.790964 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.791152 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.791384 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.791479 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.791697 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.791783 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792007 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792101 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792317 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792404 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792620 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792714 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.792923 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793008 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793229 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793361 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793556 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793681 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793860 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.793988 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794163 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794323 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794465 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794621 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794785 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.794951 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795184 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795277 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795504 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795591 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795839 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.795922 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796141 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796226 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796461 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796548 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796763 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.796905 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797071 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797216 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797377 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797525 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797680 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797844 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.797981 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798166 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798282 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798487 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798602 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798788 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.798923 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799123 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799430 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799544 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799750 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.799862 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800071 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800166 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800379 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800465 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800693 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800787 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.800994 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801087 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801313 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801400 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801631 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801725 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.801928 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802012 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802245 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802329 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802552 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802645 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802887 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.802976 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803217 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803315 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803544 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803639 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803853 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.803938 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804181 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804267 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804484 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804569 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804797 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.804883 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805098 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805196 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805401 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805526 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805768 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.805853 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806098 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806196 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806379 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806517 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806686 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.806772 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807016 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807103 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807407 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807620 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807706 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.807921 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808013 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808223 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808308 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808523 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808608 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808832 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.808925 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809134 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809224 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809455 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809541 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809755 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.809849 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810055 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810139 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810359 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810452 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810658 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810752 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.810987 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811078 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811291 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811388 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811630 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811718 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.811933 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812018 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812251 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812342 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812576 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812670 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812881 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.812965 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813201 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813288 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813516 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813603 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813829 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.813914 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814138 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814276 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814454 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814541 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814763 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.814863 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815093 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815226 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815395 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815499 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815704 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.815791 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816006 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816100 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816309 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816394 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816612 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816717 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.816916 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817125 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817220 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817449 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817537 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817761 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.817846 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818072 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818159 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818373 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818458 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818681 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.818780 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819008 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819095 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819310 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819408 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819612 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819706 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.819915 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820001 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820220 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820303 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820539 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820631 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820855 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.820940 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.821715 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.821949 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822058 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822246 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822333 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822481 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822642 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822790 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.822976 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823137 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823283 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823452 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823633 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823768 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.823943 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824079 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824250 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824390 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824566 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824689 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.824883 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825000 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825195 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825315 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825622 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825811 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.825933 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.826123 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.826242 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.826433 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.826557 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.826747 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.827077 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.827178 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.827392 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.827890 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.827982 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828062 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828062 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828202 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828313 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828414 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828624 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828710 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.828934 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829019 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829243 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829335 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829550 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829635 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.829861 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830152 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830376 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830463 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830705 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.830803 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831056 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831158 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831381 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831475 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831693 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.831780 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832008 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832103 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832337 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832448 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832643 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832737 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.832947 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833048 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833256 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833350 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833562 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833648 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833866 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.833953 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834183 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834268 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834491 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834575 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834796 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.834900 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835137 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835223 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835445 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835533 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835756 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.835975 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.836062 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.836315 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.836400 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.836630 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.836791 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.837510 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.837834 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.837920 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838149 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838250 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838456 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838541 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838776 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.838897 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839110 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839215 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839416 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839509 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839728 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.839812 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840035 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840253 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840345 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840571 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840658 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.840904 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841003 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841211 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841303 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841512 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841598 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841818 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.841912 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842119 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842214 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842441 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842527 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842744 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.842855 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843078 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843163 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843382 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843467 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843687 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843774 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.843985 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844069 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844286 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844372 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844591 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844678 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844892 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.844975 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.845198 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.845281 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.845500 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.845630 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.845804 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846025 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846111 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846365 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846464 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846679 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.846774 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847010 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847096 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847337 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847425 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847656 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847753 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.847954 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848038 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848257 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848345 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848563 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848648 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848866 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.848960 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849178 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849272 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849484 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849568 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849783 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.849868 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850085 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850182 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850392 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850479 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850696 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.850962 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851052 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851298 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851385 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851603 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851687 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.851925 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852021 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852227 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852339 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852580 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852665 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852889 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.852977 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853195 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853293 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853519 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853609 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853818 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.853903 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854121 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854205 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854421 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854515 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854731 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.854823 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.855054 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.855401 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.855625 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.855723 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.855927 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856014 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856315 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856530 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856622 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856835 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.856926 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857141 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857228 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857446 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857540 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857752 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.857839 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858064 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858148 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858377 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858464 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858684 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.858770 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859028 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859171 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859343 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859485 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859657 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859793 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.859967 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860136 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860275 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860450 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860582 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860889 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.860974 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861200 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861296 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861526 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861614 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861837 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.861923 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862141 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862229 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862525 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862609 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862829 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.862957 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863154 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863249 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863476 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863562 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863784 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.863876 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864089 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864173 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864395 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864531 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864709 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.864848 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865012 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865097 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865318 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865403 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865623 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865717 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.865930 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866016 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866232 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866318 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866535 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866665 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866857 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.866948 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867179 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867277 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867481 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867573 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867790 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.867876 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868148 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868235 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868463 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868551 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868775 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.868916 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869088 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869223 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869399 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869535 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869707 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.869910 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870016 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870224 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870312 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870528 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870614 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870833 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.870939 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871163 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871252 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871467 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871553 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871770 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.871858 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872075 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872233 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872377 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872544 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872681 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872862 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.872984 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873179 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873293 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873487 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873594 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873806 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.873893 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874123 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874217 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874431 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874517 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874752 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.874865 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875082 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875169 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875409 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875505 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875726 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.875811 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876047 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876133 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876357 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876456 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876660 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876745 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.876963 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877049 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877266 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877362 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877572 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877658 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877886 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.877969 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878233 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878332 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878489 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878576 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878790 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.878903 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879122 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879216 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879424 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879516 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879727 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.879814 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880030 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880117 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880331 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880423 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880635 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880720 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.880937 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881024 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881237 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881329 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881537 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881630 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881838 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.881935 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882140 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882226 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882441 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882535 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882747 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.882832 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.883070 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.883156 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.883370 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.883466 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884224 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884326 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884582 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884724 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884881 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.884980 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885217 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885304 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885547 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885633 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885859 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.885956 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886175 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886260 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886482 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886567 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886795 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.886915 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887126 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887211 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887446 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887542 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887766 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.887854 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888080 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888172 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888471 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888713 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.888800 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889021 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889107 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889328 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889421 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889634 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889718 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.889875 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 11:55:00.889959 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.890232 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.890537 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.890873 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.891192 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.891497 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.891821 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.892134 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.892453 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.892767 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.893075 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.893402 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.893710 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.894019 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.894330 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.894637 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.894975 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.895290 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.895603 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.895928 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.896249 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.896557 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.896880 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.897201 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.897543 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.897854 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.898191 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.898516 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.898828 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.899157 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.900121 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 11:55:00.900363 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 11:55:00.948866 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Registered counter for database nova_api Jun 06 11:55:00.959421 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO dbcounter [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Registered counter for database nova_api Jun 06 11:55:00.968425 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:00.974941 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:00.979360 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_db.sqlalchemy.engines [None req-16084103-1eb9-4526-b891-94ea3140858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:00.985923 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writer thread running {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.036784 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.context [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99b97c17-d487-4688-bea3-ee8480699263(cell1) {{(pid=103024) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 11:55:01.041637 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 11:55:01.043252 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 11:55:01.043364 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.context [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99b97c17-d487-4688-bea3-ee8480699263(cell1) {{(pid=103025) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 11:55:01.044024 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 11:55:01.045980 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 11:55:01.047425 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 11:55:01.047964 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Registered counter for database nova_cell0 Jun 06 11:55:01.048994 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 11:55:01.049785 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 11:55:01.051761 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 11:55:01.051969 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Registered counter for database nova_cell1 Jun 06 11:55:01.053719 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO dbcounter [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Registered counter for database nova_cell0 Jun 06 11:55:01.058340 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO dbcounter [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Registered counter for database nova_cell1 Jun 06 11:55:01.059537 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.061797 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.065746 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_db.sqlalchemy.engines [None req-16084103-1eb9-4526-b891-94ea3140858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.066351 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.069184 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_db.sqlalchemy.engines [None req-16084103-1eb9-4526-b891-94ea3140858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.069344 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.071803 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writer thread running {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.213518 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writer thread running {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.219586 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Registered counter for database nova_cell0 Jun 06 11:55:01.221918 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO dbcounter [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Registered counter for database nova_cell0 Jun 06 11:55:01.229248 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.232075 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_db.sqlalchemy.engines [None req-16084103-1eb9-4526-b891-94ea3140858c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 11:55:01.233945 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.236376 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writer thread running {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 11:55:01.692968 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: WARNING keystonemiddleware.auth_token [None req-16084103-1eb9-4526-b891-94ea3140858c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 11:55:01.697573 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 11:55:01.701003 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: WARNING keystonemiddleware.auth_token [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 11:55:01.704755 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 11:55:01.924076 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: WARNING keystonemiddleware.auth_token [None req-16084103-1eb9-4526-b891-94ea3140858c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 11:55:01.930051 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: WARNING keystonemiddleware.auth_token [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 11:55:01.930394 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 11:55:01.936222 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f2ddd29c0 pid: 103025 (default app) Jun 06 11:55:01.936677 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-95cdc5d3-eef4-4126-b427-54c4c9ec8951 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 11:55:01.938253 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:55:01.939463 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-16084103-1eb9-4526-b891-94ea3140858c None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jun 06 11:55:01.939874 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Mon Jun 6 11:55:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:55:01.941815 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560f2ddd29c0 pid: 103024 (default app) Jun 06 11:56:21.316097 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:21.317122 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-16084103-1eb9-4526-b891-94ea3140858c None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 06 11:56:21.317518 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:21.335281 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:21.336405 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:21.337225 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:21.338230 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:21.790434 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-517947b8-2b49-42eb-b20a-71ed6f48c152 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:21.825028 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-517947b8-2b49-42eb-b20a-71ed6f48c152 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.499373 Jun 06 11:56:21.825767 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 11:56:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:56:24.151554 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-16084103-1eb9-4526-b891-94ea3140858c None None] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:24.152275 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-16084103-1eb9-4526-b891-94ea3140858c None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 06 11:56:24.152847 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:24.221835 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7c6f472d-194c-4a81-be93-b69607d1cf44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:24.241019 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 11:56:24.241019 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 06 11:56:24.269255 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7c6f472d-194c-4a81-be93-b69607d1cf44 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108882 Jun 06 11:56:24.270167 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 11:56:24.284257 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_api:SELECT=3 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:24.285515 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_cell0:SELECT=3 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:24.286570 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_cell1:SELECT=3 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:24.287618 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:56:24.500890 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-ede17182-b67b-4ca2-8b12-8d51723822db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:24.503515 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 11:56:24.503515 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 11:56:24.566814 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-ede17182-b67b-4ca2-8b12-8d51723822db admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288412 Jun 06 11:56:24.570018 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 11:56:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:56:26.886225 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7c6f472d-194c-4a81-be93-b69607d1cf44 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:26.887291 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7c6f472d-194c-4a81-be93-b69607d1cf44 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 06 11:56:26.887874 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:27.146030 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-c263e175-475a-4194-9a6f-f5b4c8545d62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:27.164336 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 11:56:27.164336 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 11:56:27.191752 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-c263e175-475a-4194-9a6f-f5b4c8545d62 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.297352 Jun 06 11:56:27.192330 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:27.204679 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8cd4804f-7b40-4950-a104-ebee49b20a48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:27.206163 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 11:56:27.206163 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: warnings.warn(msg) Jun 06 11:56:27.237467 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8cd4804f-7b40-4950-a104-ebee49b20a48 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037134 Jun 06 11:56:27.238050 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 11:56:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:56:29.578633 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-c263e175-475a-4194-9a6f-f5b4c8545d62 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:29.580115 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-c263e175-475a-4194-9a6f-f5b4c8545d62 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002491 Jun 06 11:56:29.580730 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:29.644809 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a8aaf134-a9b6-4303-bb1c-06fc3c347354 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:29.665874 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a8aaf134-a9b6-4303-bb1c-06fc3c347354 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078831 Jun 06 11:56:29.666880 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:29.679637 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-a8154f7a-17ea-4cbd-92bb-7b7664d3ef29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:29.703449 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-a8154f7a-17ea-4cbd-92bb-7b7664d3ef29 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027376 Jun 06 11:56:29.704274 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 11:56:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:56:32.035265 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a8aaf134-a9b6-4303-bb1c-06fc3c347354 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:32.036337 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a8aaf134-a9b6-4303-bb1c-06fc3c347354 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 06 11:56:32.036747 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:32.098221 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-2b1cec78-4765-4fcf-8510-e866ee7991f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:32.117205 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-2b1cec78-4765-4fcf-8510-e866ee7991f2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073857 Jun 06 11:56:32.117775 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:32.129832 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-fb922184-00e9-4f47-8d21-64199dc0abc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:32.154125 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-fb922184-00e9-4f47-8d21-64199dc0abc5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028053 Jun 06 11:56:32.154714 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 11:56:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:56:34.543144 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-2b1cec78-4765-4fcf-8510-e866ee7991f2 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:34.544244 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-2b1cec78-4765-4fcf-8510-e866ee7991f2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 06 11:56:34.544725 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:34.604806 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:34.626732 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074210 Jun 06 11:56:34.627429 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 11:56:34.639519 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-b778156d-045a-49eb-b15f-1da5145fe4ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:34.663686 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-b778156d-045a-49eb-b15f-1da5145fe4ed admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028002 Jun 06 11:56:34.664361 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Mon Jun 6 11:56:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:56:37.003300 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:37.004921 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jun 06 11:56:37.008444 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:37 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:37.067714 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-f8496d0f-feed-4f48-a455-8ab30117290b admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:37.091037 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-f8496d0f-feed-4f48-a455-8ab30117290b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079044 Jun 06 11:56:37.091587 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 11:56:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 11:56:39.410226 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:39.411279 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f977a1ce-62b4-4260-bc46-915b2b8be77d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 06 11:56:39.411678 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:39.473146 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-115cc678-463f-498a-a734-8a48ed218141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:39.491418 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-115cc678-463f-498a-a734-8a48ed218141 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073844 Jun 06 11:56:39.492235 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 11:56:39.504748 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a9bd1a84-82e0-4c2f-9026-fb444c185710 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:39.529275 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a9bd1a84-82e0-4c2f-9026-fb444c185710 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028565 Jun 06 11:56:39.529854 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 11:56:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:56:41.868768 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-115cc678-463f-498a-a734-8a48ed218141 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:41.869896 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-115cc678-463f-498a-a734-8a48ed218141 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 06 11:56:41.870327 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:41.930250 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-853bc085-1d31-4854-8759-223bc479cd82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:41.948868 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-853bc085-1d31-4854-8759-223bc479cd82 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072493 Jun 06 11:56:41.949373 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:41.962061 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-1fb13101-05fd-4eba-9020-f60fa12365ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:41.984813 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-1fb13101-05fd-4eba-9020-f60fa12365ec admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026537 Jun 06 11:56:41.986011 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 11:56:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:56:44.276822 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-853bc085-1d31-4854-8759-223bc479cd82 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:44.277875 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-853bc085-1d31-4854-8759-223bc479cd82 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Jun 06 11:56:44.278288 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:44.338134 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-ea8a43ab-89a2-4b89-ac60-cf483d109559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:44.358286 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-ea8a43ab-89a2-4b89-ac60-cf483d109559 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073002 Jun 06 11:56:44.358867 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:44.371668 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-29e656ee-d663-444a-96b7-b899d5496eb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:44.394765 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-29e656ee-d663-444a-96b7-b899d5496eb9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027468 Jun 06 11:56:44.395386 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 11:56:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:56:46.686034 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-ea8a43ab-89a2-4b89-ac60-cf483d109559 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:46.687078 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-ea8a43ab-89a2-4b89-ac60-cf483d109559 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 06 11:56:46.687482 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:46.751198 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-c6b5cde7-28b9-4e1a-859c-4e736d412870 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "ram": 8192}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:46.771787 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-c6b5cde7-28b9-4e1a-859c-4e736d412870 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077809 Jun 06 11:56:46.772712 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:46.785552 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-2afb94f3-8f92-4406-b50f-389b0c9be36f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:46.809384 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-2afb94f3-8f92-4406-b50f-389b0c9be36f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028383 Jun 06 11:56:46.810007 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 11:56:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:56:49.151289 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-c6b5cde7-28b9-4e1a-859c-4e736d412870 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:56:49.152881 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-c6b5cde7-28b9-4e1a-859c-4e736d412870 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Jun 06 11:56:49.155129 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:56:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:56:49.219248 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:49.239490 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079695 Jun 06 11:56:49.240303 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Mon Jun 6 11:56:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:56:49.252486 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d4ccc446-6560-4dae-be60-ac24dda84386 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:56:49.277915 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d4ccc446-6560-4dae-be60-ac24dda84386 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029175 Jun 06 11:56:49.278428 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Mon Jun 6 11:56:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:57:13.807198 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:13.808245 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 06 11:57:13.808652 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:13.820028 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:57:13.868169 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bdb4956b-a5c6-4c41-b086-06bc9027f55b admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:13.886945 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bdb4956b-a5c6-4c41-b086-06bc9027f55b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072330 Jun 06 11:57:13.887483 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 11:57:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:14.886982 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:14.887993 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-35d9a561-4f75-4c98-8903-f2d51897cbbc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 06 11:57:14.888399 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:15.109432 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d8c9371a-2dc6-4f57-992b-0a72add1f1df admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:15.115209 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-d8c9371a-2dc6-4f57-992b-0a72add1f1df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d8c9371a-2dc6-4f57-992b-0a72add1f1df admin admin] Request method failure captured: Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Host: 10.222.0.41 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABineuafA9iS2e0pB_Q08rty749_e-2tTx_mQGrUGMaiXI65Xy2iz6aAfV3nNg36VRn2thTIAiRCNqsb-IlJQiTtZonxBOfzh1gVywZe8h7IyL4S9MNcRUbCU_Ztw-bs-D7MkAiLeEJuSk6X32JVW0p4A2mSjrHWYc0hyWCIInQUMzWpjo Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader Jun 06 11:57:15.118450 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User: admin Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: method: > Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: exception: Flavor 42 could not be found. Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: action_args: {'id': '42'} Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:15.120232 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:15.121520 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.123082 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d8c9371a-2dc6-4f57-992b-0a72add1f1df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:15.124385 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d8c9371a-2dc6-4f57-992b-0a72add1f1df admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061736 Jun 06 11:57:15.124385 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 11:57:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 11:57:15.130159 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-0378a0d7-e2bd-4b07-b34a-c6a841257eee admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:15.133135 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:57:15.153153 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-0378a0d7-e2bd-4b07-b34a-c6a841257eee admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026939 Jun 06 11:57:15.153693 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:15.164406 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1624f90f-4170-434e-a2d4-a9408ad5d960 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:15.185504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-1624f90f-4170-434e-a2d4-a9408ad5d960 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025292 Jun 06 11:57:15.186070 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 11:57:15.196734 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-b05fdf10-aa07-4c62-ac2b-24482d79b04a admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:15.202946 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.wsgi [None req-b05fdf10-aa07-4c62-ac2b-24482d79b04a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-b05fdf10-aa07-4c62-ac2b-24482d79b04a admin admin] Request method failure captured: Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept: application/json Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept-Encoding: gzip, deflate Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Connection: keep-alive Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Content-Length: 0 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Host: 10.222.0.41 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-System-Scope: None Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: User-Agent: python-novaclient Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Auth-Token: gAAAAABineuafA9iS2e0pB_Q08rty749_e-2tTx_mQGrUGMaiXI65Xy2iz6aAfV3nNg36VRn2thTIAiRCNqsb-IlJQiTtZonxBOfzh1gVywZe8h7IyL4S9MNcRUbCU_Ztw-bs-D7MkAiLeEJuSk6X32JVW0p4A2mSjrHWYc0hyWCIInQUMzWpjo Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Id: None Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Name: None Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Identity-Status: Confirmed Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Is-Admin-Project: True Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Id: default Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Name: Default Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Name: admin Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Role: admin,member,reader Jun 06 11:57:15.206111 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Roles: admin,member,reader Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant: admin Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Name: admin Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User: admin Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Id: default Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Name: Default Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Name: admin Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: method: > Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: exception: Flavor 42 could not be found. Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: action_args: {'id': '42'} Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:15.208545 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:15.210043 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:15.211709 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-b05fdf10-aa07-4c62-ac2b-24482d79b04a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:15.212970 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-b05fdf10-aa07-4c62-ac2b-24482d79b04a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015991 Jun 06 11:57:15.212970 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 11:57:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 11:57:16.074382 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-1624f90f-4170-434e-a2d4-a9408ad5d960 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:16.075426 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-1624f90f-4170-434e-a2d4-a9408ad5d960 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 06 11:57:16.075815 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:16.269192 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-84da3ffe-889b-4af0-bd0d-a8b45b6004ed admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:16.274978 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.wsgi [None req-84da3ffe-889b-4af0-bd0d-a8b45b6004ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-84da3ffe-889b-4af0-bd0d-a8b45b6004ed admin admin] Request method failure captured: Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept: application/json Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept-Encoding: gzip, deflate Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Connection: keep-alive Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Content-Length: 0 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Host: 10.222.0.41 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-System-Scope: None Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: User-Agent: python-novaclient Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Auth-Token: gAAAAABineuctlqEZE_-zFy4pXyUbXAoXFeirfwW-kGONaK6CAMNvbfTxA9dmVZr_26MzD91EZ2nXVZ_bK-pVcvNWOjvGAfozz3hRk_hTiBwCcIUWQA9R4CricY-MRzG5sWR7YoRx4s3udbK6Hy8-ApxB76gch4qU2pcxOIJMtoO1kIGygM4FOQ Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Id: None Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Name: None Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Identity-Status: Confirmed Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Is-Admin-Project: True Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Id: default Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Name: Default Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Name: admin Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Role: admin,member,reader Jun 06 11:57:16.276477 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Roles: admin,member,reader Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant: admin Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Name: admin Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User: admin Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Id: default Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Name: Default Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Name: admin Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: method: > Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: exception: Flavor 84 could not be found. Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: action_args: {'id': '84'} Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:16.277967 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:16.278952 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.280319 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-84da3ffe-889b-4af0-bd0d-a8b45b6004ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:16.281544 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-84da3ffe-889b-4af0-bd0d-a8b45b6004ed admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061175 Jun 06 11:57:16.281544 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 11:57:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 11:57:16.288251 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-f76ab50a-9689-475f-ae36-bb10bcf74994 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:16.301640 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-f76ab50a-9689-475f-ae36-bb10bcf74994 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017724 Jun 06 11:57:16.302154 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:16.311215 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-34873285-2aed-48e9-85b0-1501b78a55a5 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:16.325251 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-34873285-2aed-48e9-85b0-1501b78a55a5 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017474 Jun 06 11:57:16.325772 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:16.335371 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-227f12ad-63dc-46ab-a6a0-213e96ab0768 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:16.340603 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-227f12ad-63dc-46ab-a6a0-213e96ab0768 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-227f12ad-63dc-46ab-a6a0-213e96ab0768 admin admin] Request method failure captured: Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Host: 10.222.0.41 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABineuctlqEZE_-zFy4pXyUbXAoXFeirfwW-kGONaK6CAMNvbfTxA9dmVZr_26MzD91EZ2nXVZ_bK-pVcvNWOjvGAfozz3hRk_hTiBwCcIUWQA9R4CricY-MRzG5sWR7YoRx4s3udbK6Hy8-ApxB76gch4qU2pcxOIJMtoO1kIGygM4FOQ Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader Jun 06 11:57:16.342139 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User: admin Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: method: > Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: exception: Flavor 84 could not be found. Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: action_args: {'id': '84'} Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:16.343651 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:16.344487 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:16.345504 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-227f12ad-63dc-46ab-a6a0-213e96ab0768 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:16.346517 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-227f12ad-63dc-46ab-a6a0-213e96ab0768 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012140 Jun 06 11:57:16.346517 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Mon Jun 6 11:57:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 11:57:17.208619 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-34873285-2aed-48e9-85b0-1501b78a55a5 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:17.209786 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-34873285-2aed-48e9-85b0-1501b78a55a5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Jun 06 11:57:17.210187 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:17.396772 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-fd017609-1b20-430e-8bc9-4329350c523b admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:17.402445 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-fd017609-1b20-430e-8bc9-4329350c523b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-fd017609-1b20-430e-8bc9-4329350c523b admin admin] Request method failure captured: Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept: application/json Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Connection: keep-alive Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Content-Length: 0 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Host: 10.222.0.41 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABineudFFA41gROtu06Ls7M-RG4XIVVNfCiDuiN6RZ1Qc03AyA4t8unHMClQSL9iYwbJQoepSEmW4T2eQLNgsrdS8dkJ9mRJvTmAz-rVy2kbOXt8FQ_-b9c1dL91MPydwnCAoFVOxOOHNcyyLS8G0bql8ppPEWVhlGRhGTmCylJqTkZoOU Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Id: None Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Domain-Name: None Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Project-Name: admin Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader Jun 06 11:57:17.404039 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant: admin Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User: admin Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: X-User-Name: admin Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: method: > Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: exception: Flavor 451 could not be found. Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: action_args: {'id': '451'} Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:17.405563 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:17.406634 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.408065 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-fd017609-1b20-430e-8bc9-4329350c523b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:17.409342 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-fd017609-1b20-430e-8bc9-4329350c523b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060781 Jun 06 11:57:17.409342 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 11:57:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 11:57:17.415615 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-4aa6bdd1-3ea0-41f5-940f-69ae47b20978 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:17.429883 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-4aa6bdd1-3ea0-41f5-940f-69ae47b20978 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017818 Jun 06 11:57:17.430404 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:17.439780 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:17.453343 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017096 Jun 06 11:57:17.453869 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Mon Jun 6 11:57:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:57:17.462814 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-01ca0081-73db-46fa-bb11-603cfd8caf78 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:17.467991 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.wsgi [None req-01ca0081-73db-46fa-bb11-603cfd8caf78 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-01ca0081-73db-46fa-bb11-603cfd8caf78 admin admin] Request method failure captured: Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept: application/json Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Accept-Encoding: gzip, deflate Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Connection: keep-alive Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Content-Length: 0 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Host: 10.222.0.41 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-Api-Version: compute 2.90 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Openstack-System-Scope: None Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: User-Agent: python-novaclient Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Auth-Token: gAAAAABineudFFA41gROtu06Ls7M-RG4XIVVNfCiDuiN6RZ1Qc03AyA4t8unHMClQSL9iYwbJQoepSEmW4T2eQLNgsrdS8dkJ9mRJvTmAz-rVy2kbOXt8FQ_-b9c1dL91MPydwnCAoFVOxOOHNcyyLS8G0bql8ppPEWVhlGRhGTmCylJqTkZoOU Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Id: None Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Domain-Name: None Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Identity-Status: Confirmed Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Is-Admin-Project: True Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Id: default Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Domain-Name: Default Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Project-Name: admin Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Role: admin,member,reader Jun 06 11:57:17.469478 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Roles: admin,member,reader Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a70232cae3264ff0a2f3b7ce99f87508", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a70232cae3264ff0a2f3b7ce99f87508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant: admin Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Id: a70232cae3264ff0a2f3b7ce99f87508 Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-Tenant-Name: admin Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User: admin Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Id: default Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Domain-Name: Default Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Id: b408ca5ee3cd4f8b9e1f61c55e26955b Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: X-User-Name: admin Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: method: > Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: exception: Flavor 451 could not be found. Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: action_args: {'id': '451'} Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 11:57:17.471190 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:17.472358 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: ERROR nova.api.openstack.wsgi Jun 06 11:57:17.474386 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-01ca0081-73db-46fa-bb11-603cfd8caf78 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 11:57:17.475770 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-01ca0081-73db-46fa-bb11-603cfd8caf78 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011402 Jun 06 11:57:17.475770 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 11:57:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 06 11:57:18.341220 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:18.342216 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 06 11:57:18.342603 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:18.532646 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-e1ba78f1-248b-4c74-8547-176b890015d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:57:18.550181 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-e1ba78f1-248b-4c74-8547-176b890015d5 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069627 Jun 06 11:57:18.550661 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 11:57:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:57:19.440372 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:19.441372 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 06 11:57:19.442953 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:19.632824 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-f4bd5de8-efe7-4759-8d33-081e5505b13f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:57:19.649591 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-f4bd5de8-efe7-4759-8d33-081e5505b13f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068259 Jun 06 11:57:19.650045 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 11:57:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:57:20.519041 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:20.520687 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 06 11:57:20.521087 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:20.719368 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-4034b2fe-ef1f-42c2-aba0-42ecb15047f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:57:20.736617 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-4034b2fe-ef1f-42c2-aba0-42ecb15047f4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076993 Jun 06 11:57:20.737069 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 11:57:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:57:21.623362 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:21.624402 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 06 11:57:21.624827 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:21.813856 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-30ccf2e3-8702-4046-9055-181c2c8be546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 11:57:21.833127 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-30ccf2e3-8702-4046-9055-181c2c8be546 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069609 Jun 06 11:57:21.833632 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Mon Jun 6 11:57:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 11:57:22.702301 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:22.703340 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 06 11:57:22.703736 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 11:57:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:57:22.890351 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-01dd6acc-82c0-4ed5-89dc-fa71fd3c3acd admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:57:22.909844 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-01dd6acc-82c0-4ed5-89dc-fa71fd3c3acd admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070464 Jun 06 11:57:22.910375 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Mon Jun 6 11:57:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:58:24.279455 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.280457 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-51814c26-36ed-4353-8d08-410cd08c4938 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 06 11:58:24.280863 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 11:58:24.292444 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:58:24.342878 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-7717f193-fc7f-45fb-9776-7af3f60ba2c0 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.363605 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-7717f193-fc7f-45fb-9776-7af3f60ba2c0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076076 Jun 06 11:58:24.364174 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 11:58:24.385077 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=14 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 11:58:24.388791 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-2eecd42e-2c13-4460-ac78-f4eee1a37131 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.396800 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-2eecd42e-2c13-4460-ac78-f4eee1a37131 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013157 Jun 06 11:58:24.397321 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:58:24.410390 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-12672594-cea4-444c-b3d8-7a355f17082c admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.419643 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-12672594-cea4-444c-b3d8-7a355f17082c admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014566 Jun 06 11:58:24.420499 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 11:58:24.431350 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.438628 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010721 Jun 06 11:58:24.439171 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 11:58:24.450543 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-114ea152-4a69-4621-b2c8-545c6c1d4168 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 11:58:24.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-114ea152-4a69-4621-b2c8-545c6c1d4168 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011881 Jun 06 11:58:24.459280 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Mon Jun 6 11:58:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:01:37.083209 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:37.084209 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 06 12:01:37.084605 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 12:01:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:01:37.241209 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_api:SELECT=6 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:01:37.359374 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:37.360613 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 12:01:37.360613 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 12:01:37.361808 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:37.362250 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:37.363067 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:37.363495 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:37.396430 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-945555c2-f350-41c0-999a-d3fc8cb8de9b admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156738 Jun 06 12:01:37.396997 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 12:01:37 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 12:01:38.296508 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:38.297513 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 06 12:01:38.297911 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 12:01:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:01:38.489492 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:38.493579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:38.513195 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-47880e54-f65b-471c-9a7a-2c876a35cd12 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074783 Jun 06 12:01:38.513687 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 12:01:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:01:49.803495 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:49.804523 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 06 12:01:49.804911 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 12:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:01:49.951698 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_cell0:SELECT=4 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:01:49.952405 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_cell1:SELECT=4 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:01:49.953069 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG dbcounter [-] [103025] Writing DB stats nova_api:SELECT=8 {{(pid=103025) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:01:50.002175 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:50.003363 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 12:01:50.003363 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 12:01:50.004579 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:50.005010 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:50.005782 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:50.006204 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:50.033554 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-86053734-1fbb-4f3b-9caf-0cda74d3f481 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087163 Jun 06 12:01:50.034110 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 12:01:49 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:01:50.913572 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:50.914560 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d6f34d89-f05f-47f1-9a4a-f60981da0759 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 06 12:01:50.915001 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Mon Jun 6 12:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:01:51.105576 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG nova.api.openstack.wsgi [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] Calling method '>' {{(pid=103025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:01:51.107522 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 12:01:51.107522 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: warnings.warn(msg) Jun 06 12:01:51.108688 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:51.109121 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:51.109895 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:01:51.110316 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: DEBUG oslo_concurrency.lockutils [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:01:51.131339 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: INFO nova.api.openstack.requestlog [None req-114392f7-7a75-4428-97b3-f6cceea8aaa6 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077079 Jun 06 12:01:51.131885 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: [pid: 103025|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Mon Jun 6 12:01:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:02:49.077698 dv-cinder-825492-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 12:02:49.078384 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: Mon Jun 6 12:02:49 2022 - graceful shutdown triggered... Jun 06 12:02:49.078875 dv-cinder-825492-20-iscsi devstack@n-api.service[103024]: Gracefully killing worker 1 (pid: 103024)... Jun 06 12:02:49.079247 dv-cinder-825492-20-iscsi devstack@n-api.service[103025]: Gracefully killing worker 2 (pid: 103025)... Jun 06 12:02:50.079540 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: worker 1 buried after 1 seconds Jun 06 12:02:50.079540 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: worker 2 buried after 1 seconds Jun 06 12:02:50.079540 dv-cinder-825492-20-iscsi devstack@n-api.service[103023]: goodbye to uWSGI. Jun 06 12:02:50.081441 dv-cinder-825492-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 12:02:50.082040 dv-cinder-825492-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 12:02:50.084743 dv-cinder-825492-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 12:02:50.097569 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 12:02:50 2022] *** Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: nodename: dv-cinder-825492-20-iscsi Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: machine: x86_64 Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: clock source: unix Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: pcre jit disabled Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: detected number of CPU cores: 4 Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: current working directory: / Jun 06 12:02:50.111198 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: detected binary path: /usr/bin/uwsgi-core Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: your processes number limit is 47680 Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: your memory page size is 4096 bytes Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: detected max file descriptor number: 2048 Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: lock engine: pthread robust mutexes Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: thunder lock: enabled Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 12:02:50.111978 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 12:02:50.156694 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: Python main interpreter initialized at 0x55f2f986e9c0 Jun 06 12:02:50.156694 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: python threads support enabled Jun 06 12:02:50.156694 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: your server socket listen backlog is limited to 100 connections Jun 06 12:02:50.156694 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: your mercy for graceful operations on workers is 90 seconds Jun 06 12:02:50.157132 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 12:02:50.157132 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: *** Operational MODE: preforking *** Jun 06 12:02:50.157404 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: *** uWSGI is running in multiple interpreter mode *** Jun 06 12:02:50.157404 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: spawned uWSGI master process (pid: 117613) Jun 06 12:02:50.157611 dv-cinder-825492-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 12:02:50.158862 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: spawned uWSGI worker 1 (pid: 117629, cores: 1) Jun 06 12:02:50.158862 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: spawned uWSGI worker 2 (pid: 117630, cores: 1) Jun 06 12:02:50.158862 dv-cinder-825492-20-iscsi devstack@n-api.service[117613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 12:02:51.419036 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 12:02:51.436734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 12:02:52.250677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:02:52.250677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: from cryptography.utils import int_from_bytes Jun 06 12:02:52.251024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:02:52.251024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: from cryptography.utils import int_from_bytes Jun 06 12:02:52.268922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:02:52.268922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: from cryptography.utils import int_from_bytes Jun 06 12:02:52.269300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:02:52.269300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: from cryptography.utils import int_from_bytes Jun 06 12:02:54.634976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:02:54.636385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:02:54.636385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:02:54.636385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:02:54.636768 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:02:54.637119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.637275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.637581 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.637907 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.638248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.638561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.638908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.639242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.639581 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.639848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.640146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.640479 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-20-iscsi {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.640806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.641120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.641436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.641743 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.642059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.642398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.642707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.643321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.645627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.645627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.645627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.645627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.645627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.647388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-20-iscsi {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.649146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.649146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.649146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.649146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.649146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.654386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.655949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.656941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.658653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.659418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.659418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.659418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.659783 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.659920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.660241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.660553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.660876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.661281 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.661537 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.661849 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.662195 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.662519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.662834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.663190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.663517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.663831 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.664143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.664454 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.664777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.665118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.665434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.665717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.666027 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.666339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.666658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.667003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.667321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.667631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.667936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.668247 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.668553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.668861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.669173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.669483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.669791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.670101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.670410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.670718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.671065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.671393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.671703 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.672012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.672322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.672630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.672950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.673260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.673569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.673893 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.674201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.674510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.674829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.675174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.675489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.675811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.676115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.676425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.676746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.677059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.677370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.677679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.677990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.678294 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.678602 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.678941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.679241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.679541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.679865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.680192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.680503 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.680813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.681121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.681575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.682177 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.682522 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.682896 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.683225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.683567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.683904 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.684226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.684543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.684864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.685280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.685525 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.685808 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.686125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.686447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.686819 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.687114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.687424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.687792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.688078 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.688395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.688753 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.689037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.689366 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.689681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.690022 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.690369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.690685 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.691039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.691368 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.691682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.691994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.692305 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.692628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.692963 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.693280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.693601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.693918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.694234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.694547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.694893 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.695199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.695541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.695860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.696180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.696494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.697338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.697875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.698193 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.698511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.698948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.699149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.699459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.699771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.700078 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.700402 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.700734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.701045 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.701383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.701692 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.702009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.702323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.702636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.702975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.703282 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.703595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.703902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.704228 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.704541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.704849 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.705174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.705483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.705790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.706113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.706425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.706740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.707080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.707394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.707721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.708042 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.708356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.708699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.709108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.709318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.709635 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.709962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.710280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.710587 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.710922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.711240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.711548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.711843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.712149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.713257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.713566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.713873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.714180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.714486 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.714811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.715216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.715525 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.715833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.716145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.716492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.716802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.716959 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:02:54.717440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.717592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:02:54.717735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.717876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:02:54.718180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.718346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:02:54.718562 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.718861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:02:54.719053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.719295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.719443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.719597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.719749 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.719889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.720037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.720179 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.720319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.720483 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.720632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.720774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.720921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.721061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.721201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.721356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.721497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.721636 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.721783 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.721931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.722085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.722244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.722385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.722533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-20-iscsi {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.722682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.722682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.722989 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.723132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.723279 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.723420 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.723560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.723706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.723866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.724009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.724159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.724299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.724460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.724601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.724751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.724899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.725048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.725215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.725356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.725510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.725679 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.725835 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.725977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.726123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.726123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.726399 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.726546 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.726687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.726850 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.726999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.727150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.727300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.727456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.727604 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.727776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.727932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.728252 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.728412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.728594 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.728832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-20-iscsi {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.728988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.728988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.729285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.729532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.729717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.729872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.730020 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.730187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.730344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.730500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.730647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.730801 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.730986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.731136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.731294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.731548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.731710 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.731866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.732014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.732183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.732346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.732501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.732501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.732789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.732936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.733090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.733251 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.733399 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.733553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.733700 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.733847 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.734002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.734168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.734330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.734490 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.734639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.734799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.734985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.735134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.735281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.735281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.735562 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.735714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.735870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.736027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.736193 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.736350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.736507 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.736666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.736830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.736986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.737142 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.737298 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.737448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.737606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.737761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.738061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.738340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.738506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.738672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.738946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.739118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.739275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.739423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.739669 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.739839 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.739999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.740157 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.740306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.740464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.740619 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.740842 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.740992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.741146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.741294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.741441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.741594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.741778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.741988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.742140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.742286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.742440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.742599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.742759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.742930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.743091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.743239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.743386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.743547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.743727 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.743883 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.744041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.744041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.744334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.744507 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.744663 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.744812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.744969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.745117 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.745271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.745428 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.745583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.745736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.745884 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.746031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.746184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.746344 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.746510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.746665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.746819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.747073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.747244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.747400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.747555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.747555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.747851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.747851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.748234 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.748478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.748634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.748800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.748948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.749129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.749292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.749446 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.749601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.749864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.750026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.750183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.750330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.750478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.750625 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.750784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.750984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.751142 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.751299 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.751446 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.751600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.751756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.751904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.752058 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.752214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.752369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.752369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.752702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.752921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.753092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.753266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.753418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.753567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.753727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.753875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.754021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.754174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.754334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.754492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.754649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.754798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.755006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.755156 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.755310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.755458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.755605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.755758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.755915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.756063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.756218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.756367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.756515 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.756662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.756823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.756988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.757135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.757284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.757438 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.757620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.757783 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.757783 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.758074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.758240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.758479 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.758709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.758892 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.759059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.759249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.759899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.760066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.760613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.760719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.760810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.760894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.760977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.761164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761256 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.761346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.761517 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.761691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.761865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.761946 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762288 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762375 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.762905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:02:54.762989 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763084 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763365 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763716 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.763961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764618 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.764937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765036 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765244 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765673 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.765950 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766795 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.766905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767147 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767320 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767465 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767774 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.767865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768082 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768701 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.768801 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769008 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.769960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770577 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.770909 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771530 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771625 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.771934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772238 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.772861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773172 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773376 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773476 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.773792 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.774727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.775657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776847 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.776952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.777912 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778221 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778752 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.778873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779177 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779721 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.779821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780433 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.780978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781291 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781704 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.781934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782022 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.782922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783515 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783826 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.783923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784762 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.784865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.785798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786006 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786321 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.786968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787372 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787598 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.787907 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788219 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788529 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.788846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.789003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.789169 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.789282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.789573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.789888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.790162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.790259 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.790413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.790587 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.790696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791402 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791805 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.791887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.792237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.792358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.792548 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.792658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.792862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793174 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793273 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.793889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.794885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795097 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795499 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.795838 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796157 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.796783 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797004 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797329 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.797973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.798953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799273 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.799917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800412 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800562 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.800889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.801984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802165 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802302 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802606 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802868 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.802962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803302 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803836 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.803928 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804801 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.804901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805218 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805434 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.805867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.806076 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.806168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807544 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807912 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.807996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808209 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.808811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809470 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.809979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810616 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.810950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811279 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811584 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.811912 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812239 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.812875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813068 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813699 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.813803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814655 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.814760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.815977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.816946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817673 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.817992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.818942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.819856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820082 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.820798 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821019 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.821736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.822648 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823276 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823368 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823632 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.823939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.824904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825471 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825787 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.825885 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826527 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.826887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.827170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.827427 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.827542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.827745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.827836 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828701 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.828800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829670 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.829822 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830073 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830705 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.830881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831045 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831367 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.831990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.832914 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833402 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833536 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.833834 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834727 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.834820 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835709 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.835800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836651 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836749 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.836963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.837054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.837586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.837709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.837939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838519 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838796 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.838961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839175 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839266 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839641 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.839946 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840535 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.840845 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841066 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841481 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.841889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.842982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.843201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.843322 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.843523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.843671 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.843860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844012 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844670 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.844985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845593 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.845904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.846852 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847081 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847409 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847723 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.847817 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.848970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.849201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.849292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.849559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.849695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.849883 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.850944 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851459 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851775 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.851881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852087 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.852811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853020 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853141 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853613 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.853889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854141 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.854992 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855099 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855612 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855705 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.855923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.856958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.857876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.858829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859701 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.859843 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860340 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.860977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.861922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862890 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.862999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.863213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.863326 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.863544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.863636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.863876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864419 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864519 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.864839 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865419 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.865830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866042 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866352 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866667 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.866757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867013 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867425 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.867953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.868080 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.868268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.868384 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.868578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.869214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.869429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.869567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.869764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870378 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.870788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871657 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871749 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.871976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.872963 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873063 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873705 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.873923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874650 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.874989 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875535 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.875955 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876602 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.876923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.877878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878509 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.878824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.879829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880170 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880451 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.880825 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881348 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881656 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881792 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.881967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882066 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882416 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.882931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883039 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883349 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883554 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.883962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.884166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.884267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.884591 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885099 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885329 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.885838 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.886949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.887970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888496 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888590 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.888908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889433 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.889923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890381 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.890799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891028 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891340 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891663 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891766 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.891972 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892608 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.892934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893558 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.893961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894807 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.894931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895141 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.895878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.896861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897182 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.897821 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.898775 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899322 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899637 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.899737 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.900620 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.900780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.900922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901010 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901703 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.901795 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902789 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.902992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903083 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903322 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.903952 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.904865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:02:54.904964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.905226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.905570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.905895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.906225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.906559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.906895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.907228 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.907553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.907876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.908200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.908522 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.908842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.909163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.909485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.909802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.910125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.910451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.910775 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.911336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.911676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.911999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.912321 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.912640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.912962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.913281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.913598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.913914 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.914230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.914544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.914900 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.915233 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.915583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.916697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.916892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.917224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.917549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.917875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.918239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.918562 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.918898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.919224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.919550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.919873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.920194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.920514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.920837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.921162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.921482 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.921800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.922124 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.922448 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.922781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.923148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.923479 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.923801 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.924225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.924443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.924976 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.925300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.925642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.925975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.926308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.926633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.926982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.927319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.927632 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.927945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.928264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.928579 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.928891 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.929220 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.929537 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.929849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.930176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.930492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.931061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.931500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.931896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.932235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.932733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.933070 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.933388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.933723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.934038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.934352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.934681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.935034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.935352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.935667 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.935989 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.936309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.936623 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.936943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.937257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.937592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.937907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.938222 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.938536 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.938939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.939264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.939579 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.939893 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.940206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.940530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.940842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.941159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.941471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.941803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.942107 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.942424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.942793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.943161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.943476 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.943787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.944111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.944430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.944760 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.945088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.945408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.945759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.946083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.946631 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.947113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.947514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.947749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.948086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.948405 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.948721 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.949033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.949364 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.949683 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.949999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.950314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.950631 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.950971 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.951289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.951605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.951920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.952235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.952551 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.952869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.953186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.953503 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.953823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.954169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.954494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.954817 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.955165 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.955491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.955809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.956131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.956449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.956765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.957085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.957424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.957746 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.958060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.958490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.958811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.959162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.959492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.959810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.960139 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.960469 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.960788 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.961116 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.961438 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.961768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.962111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.963253 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.963662 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.963901 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.964213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.964527 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.964843 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.965168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.965489 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.965778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Registered counter for database nova_api Jun 06 12:02:54.965880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.966097 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.966412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.966724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.967061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.967374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.967684 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.967999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.968308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.968618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.968928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.969237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.969547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.969857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.970170 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.970479 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.970789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.971135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.971446 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.971755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.972093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.972434 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.972755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.973082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.973402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.973729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.974042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.974368 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.974695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.975040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.975355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.975698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.976016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.976334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.976653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.976969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.977285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.977600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.977934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.978582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.978582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.978977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.979310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.979638 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.979960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.980284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.980898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.981086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.981498 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.981818 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.981912 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.982152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.982476 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.982797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.983154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.983486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.983803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.984136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.984469 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.984827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.985149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.985505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.985842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.985942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:54.986166 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.986484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.986799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:02:54.987075 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:02:54.992548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.049598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Registered counter for database nova_api Jun 06 12:02:55.049842 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.context [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99b97c17-d487-4688-bea3-ee8480699263(cell1) {{(pid=117629) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 12:02:55.054163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:02:55.055773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:02:55.057110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:02:55.059210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:02:55.061205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Registered counter for database nova_cell0 Jun 06 12:02:55.066748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Registered counter for database nova_cell1 Jun 06 12:02:55.070003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.075871 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.079332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.079492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.082476 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.139351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.context [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99b97c17-d487-4688-bea3-ee8480699263(cell1) {{(pid=117630) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 12:02:55.143691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:02:55.145270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:02:55.146100 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:02:55.148111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:02:55.150206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Registered counter for database nova_cell0 Jun 06 12:02:55.155829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Registered counter for database nova_cell1 Jun 06 12:02:55.164094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.165257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.171772 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.173385 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.225060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.238055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO dbcounter [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Registered counter for database nova_cell0 Jun 06 12:02:55.245535 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_db.sqlalchemy.engines [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.250230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writer thread running {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.323741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO dbcounter [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Registered counter for database nova_cell0 Jun 06 12:02:55.331673 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_db.sqlalchemy.engines [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:02:55.336376 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writer thread running {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:02:55.705231 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:02:55.713583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:02:55.792713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:02:55.800876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:02:55.943071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:02:55.949662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: WARNING keystonemiddleware.auth_token [None req-c18433df-ac26-46a3-8d33-0e84a06a39e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:02:55.955012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f2f986e9c0 pid: 117629 (default app) Jun 06 12:02:56.038538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:02:56.044957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: WARNING keystonemiddleware.auth_token [None req-7ab8cac7-da22-4db2-8d27-199ec361174c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:02:56.050180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f2f986e9c0 pid: 117630 (default app) Jun 06 12:03:40.477464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:40.479589 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:40.480609 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:40.481647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:41.064388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-858451030", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "networks": [{"uuid": "43b5120b-295c-49d0-80b2-9aba8fb27eaa"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:03:41.414447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] validate_networks() for [('43b5120b-295c-49d0-80b2-9aba8fb27eaa', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:03:43.833183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:03:43.834520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:03:43.835949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:03:43.836990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:03:43.837661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:03:43.872257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:43.873966 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:43.875065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:43.878192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:43.976903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Getting quotas for project 30f4ac789e8e41468a98175ef8d60d18. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:03:44.007779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Getting quotas for user 3ba79450153f4399bfe9d3900ed12523 and project 30f4ac789e8e41468a98175ef8d60d18. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:03:44.039093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:03:44.050731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:03:44.305457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-973577bf-7cfd-459e-a0d7-74bc6e538e29 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.834368 Jun 06 12:03:44.312753 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:03:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:03:45.207506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-60ae2c14-d745-4d19-99e0-a0a76fa420cf tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:45.210087 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-60ae2c14-d745-4d19-99e0-a0a76fa420cf tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:45.279879 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:45.294262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:45.296512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:45.298726 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:47.635084 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-60ae2c14-d745-4d19-99e0-a0a76fa420cf tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:47.670393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-60ae2c14-d745-4d19-99e0-a0a76fa420cf tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1214 microversion: 2.1 time: 3.354352 Jun 06 12:03:47.671390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 1/2] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:44 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1214 bytes in 3359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:03:48.689592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:48.690225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:48.734500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:48.734977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:48.735745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:48.744178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:49.275452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:49.294241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e5ef8a07-7bd9-47ca-b4b1-6dde7b11dd88 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1266 microversion: 2.1 time: 0.608729 Jun 06 12:03:49.310478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:48 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1266 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:03:50.312128 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:50.313588 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:50.344111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:50.345920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:50.353506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:50.356461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:51.608537 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:51.631935 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4e985da3-499e-4671-b63c-9a49a6fe15da tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1272 microversion: 2.1 time: 1.324203 Jun 06 12:03:51.642263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:50 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1272 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:03:52.665103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:52.665103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:52.666457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:52.690367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:52.693765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:52.697019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:52.901773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:52.916219 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0bc26adf-96f5-42b6-875d-47b989648a63 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1272 microversion: 2.1 time: 0.270210 Jun 06 12:03:52.917840 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 3/5] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:52 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1272 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:03:53.935939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:53.936605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:53.945968 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:53.950723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:53.951615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:53.952062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:54.861700 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:54.869570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e5ed8514-b34a-4af3-b23d-a71c10f5b099 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.937322 Jun 06 12:03:54.891750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 3/6] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:53 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:03:55.887398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:55.888918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:55.892926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:55.898108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:55.908284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:55.909445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:55.911072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:55.911792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:56.777659 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-379502963", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:03:57.075342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] validate_networks() for [('c811b86e-7c98-4caa-b820-e85c34312902', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:03:57.655633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:03:57.755346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:57.771796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a75ac218-70b2-4083-804a-a61190d34167 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.889876 Jun 06 12:03:57.772534 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:55 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:03:58.791653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:03:58.793102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:03:58.820330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:58.821902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:58.828205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:03:58.830702 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:03:59.885359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:03:59.898011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-65cd23fe-3e7b-4fdb-af48-27bc1ce1cba9 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.111756 Jun 06 12:03:59.901793 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 5/8] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:03:58 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:00.918111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:00.919649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:00.939104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:00.939564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:00.957640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:00.958121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:01.971820 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:01.972292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:01.972719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:01.973290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:01.973866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:02.071300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:02.072586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:02.076082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:02.077696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:02.171114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:02.190687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for user 473532c21cad4c3492c8425855993b0f and project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:02.250274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:02.260458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:02.469922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e7c1eaa1-65c2-42c4-a890-70f10c09109b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.052530 Jun 06 12:04:02.471087 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 4/9] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:03:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 6057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 12:04:02.712684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:02.721329 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-408a7871-c156-4da0-a103-e407b1051700 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.808083 Jun 06 12:04:02.747000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 6/10] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:00 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:02.751950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7f52e33f-cf8c-46ae-8779-e32dc4bfed21 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:02.752571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7f52e33f-cf8c-46ae-8779-e32dc4bfed21 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:02.770556 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c3125e5c-a72e-4c63-8a05-12079d8a9f42 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: .version_select at 0x7fc169c8c670>, body: {"keypair": {"name": "tempest-keypair-811249727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJn3JvY7NHRqdOVIAuMw8m8kQbQ/FuCHPhV8Om7sN6iyhpoXKu6bMLnHv0Ca3VVW17ihQbeqadKuIYR6/9cB8t3w7fMWoHus/Y++ozcUc7ELFerVLWDzgRI2ei32selzw=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:02.906022 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-c3125e5c-a72e-4c63-8a05-12079d8a9f42 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:02.933693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-c3125e5c-a72e-4c63-8a05-12079d8a9f42 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:03.035991 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c3125e5c-a72e-4c63-8a05-12079d8a9f42 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.562196 Jun 06 12:04:03.048913 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 5/11] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:04:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:03.432591 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-0fec6cf3-ae26-4324-91a6-a7ed6b2c8b12 req-28e71b9b-bd10-45ec-9ad1-ed1ab9bc7b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6912d9bb-9d85-4b29-930a-26a7c47e68db", "tag": "620d35c5-5cdf-435b-a9e0-1e021dcadaef"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:03.558652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7f52e33f-cf8c-46ae-8779-e32dc4bfed21 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:03.560021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0fec6cf3-ae26-4324-91a6-a7ed6b2c8b12 req-28e71b9b-bd10-45ec-9ad1-ed1ab9bc7b65 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:03.564324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0fec6cf3-ae26-4324-91a6-a7ed6b2c8b12 req-28e71b9b-bd10-45ec-9ad1-ed1ab9bc7b65 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:03.577234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7f52e33f-cf8c-46ae-8779-e32dc4bfed21 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1221 microversion: 2.1 time: 0.829024 Jun 06 12:04:03.584397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 7/12] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:02 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1221 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:03.712572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-0fec6cf3-ae26-4324-91a6-a7ed6b2c8b12 req-28e71b9b-bd10-45ec-9ad1-ed1ab9bc7b65 service nova] Creating event network-changed:620d35c5-5cdf-435b-a9e0-1e021dcadaef for instance 6912d9bb-9d85-4b29-930a-26a7c47e68db on hv-cinder-82549 Jun 06 12:04:03.716836 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0fec6cf3-ae26-4324-91a6-a7ed6b2c8b12 req-28e71b9b-bd10-45ec-9ad1-ed1ab9bc7b65 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 12:04:03.719985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:03.720687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:03.722680 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:03.723417 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:03.739512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:03.740966 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:03.751424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:03.755050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.compute.rpcapi [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 12:04:03.756429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] Releasing lock "compute-rpcapi-router" {{(pid=117630) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 12:04:03.760902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:03.763875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:03.765280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:03.811913 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-10fb1aee-09e3-4aca-9637-6e7b5af00dfa None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.761207 Jun 06 12:04:03.813078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 6/13] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:04.482255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bfa55c94-2718-4ab8-8a05-f8991af77506 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: .version_select at 0x7fc168c423a0>, body: {"keypair": {"name": "tempest-keypair-680661297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsnx4rsCa3T6tcELFnQv9d3OChdEVYz0y1OHmCGtiGYiSchDYosEaiLJa7RaK16Fuwrjw1qycJjC/kJOypu0FpIGsiZQD1VStJFWi5IKTQofA+BR9XGt+2+deeZm0ilog=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:04.521549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-bfa55c94-2718-4ab8-8a05-f8991af77506 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for project ffaf09bc77914692bb965b55af538141. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:04.537041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-bfa55c94-2718-4ab8-8a05-f8991af77506 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for user 6c904a413f6a4ba49686debac817c70d and project ffaf09bc77914692bb965b55af538141. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:04.611001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bfa55c94-2718-4ab8-8a05-f8991af77506 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.726948 Jun 06 12:04:04.615749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 7/14] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:04:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:04:04.630044 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2000150636", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:04.774523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] validate_networks() for [('c811b86e-7c98-4caa-b820-e85c34312902', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:04:04.980305 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:04.997249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a55e1711-caa7-43fa-ae4a-6bdc3cc0998c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.261575 Jun 06 12:04:05.016001 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 8/15] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:03 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:06.035114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:06.039708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:06.065655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:06.070316 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:06.073192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:06.082569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:07.365095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:07.379385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f3197227-e7ff-4678-96fc-8b6d6eb3f6f4 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.350126 Jun 06 12:04:07.380068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 9/16] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:06 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:08.179369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:08.179850 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:08.180266 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:08.180715 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:08.181135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:08.199856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:08.200318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:08.201128 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:08.201570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:08.248657 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:08.262832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for user 473532c21cad4c3492c8425855993b0f and project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:08.299442 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:08.299886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:08.399958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:08.401746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:08.451973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f2af4eb2-8b19-4797-b536-08b2a123d2e9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.836617 Jun 06 12:04:08.456025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:08.456812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:08.457810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:08.457989 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 8/17] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:04:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:04:08.458411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:08.476903 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b1966150-4216-4fb2-90ad-ecc5983489e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:08.477977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b1966150-4216-4fb2-90ad-ecc5983489e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:09.271226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b1966150-4216-4fb2-90ad-ecc5983489e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:09.278451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b1966150-4216-4fb2-90ad-ecc5983489e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1222 microversion: 2.1 time: 0.814551 Jun 06 12:04:09.296837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 9/18] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:08 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1222 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:09.393847 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:09.413952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b413afd3-5378-4651-8c63-0f847ce24dc1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.020573 Jun 06 12:04:09.422757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 10/19] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:08 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:10.313226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:10.313839 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:10.328943 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:10.329299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:10.330071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:10.330665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:10.402004 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e97e859d-9a1e-434b-b4db-1b47850fa1a3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: .version_select at 0x7fc168c429d0>, body: {"keypair": {"name": "tempest-keypair-498578206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh61N7dotZC+lEH74dr5x9ziyvbRzUgihU2efvQuIxpqbtHHfMyhsycS4sa6mtvWRBE/0yIAjAL2kZeBDhT9BqAibMQthS0I07Lpucyv4fkYSTWJE9CX1V5bAQqKNcELg=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:10.447689 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e97e859d-9a1e-434b-b4db-1b47850fa1a3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for project e4e76a3125df4436abf5f788e35d492f. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:10.455128 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e97e859d-9a1e-434b-b4db-1b47850fa1a3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for user c8bda0c079054e198ffeca4c0ac18bf2 and project e4e76a3125df4436abf5f788e35d492f. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:10.500231 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e97e859d-9a1e-434b-b4db-1b47850fa1a3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.562252 Jun 06 12:04:10.502764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 10/20] 10.222.0.41 () {62 vars in 1199 bytes} [Mon Jun 6 12:04:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 565 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 12:04:10.513559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:10.515566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:10.529720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:10.535132 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:10.536413 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:10.538860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:10.861872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:10.874230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=55 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:10.879831 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9c805f85-96f2-4eb3-97c0-398ea4e3a2d4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1226 microversion: 2.1 time: 0.567736 Jun 06 12:04:10.880653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 11/21] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:10 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1226 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:11.045244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:11.056335 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9260f496-9617-4019-ae15-7fbaaa4b2c47 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.551601 Jun 06 12:04:11.071241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:10 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:11.268417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1939482249", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43ca690c-a1bc-4f83-bc21-4d7b4fd16d4d"}], "security_groups": [{"name": "tempest-securitygroup--1682410751"}], "key_name": "tempest-keypair-680661297", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:11.312378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:11.634388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] validate_networks() for [('43ca690c-a1bc-4f83-bc21-4d7b4fd16d4d', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:04:11.900081 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:11.901031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:11.910981 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:11.914583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:11.916166 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:11.918262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:12.017478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:12.050792 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-88eb516f-4147-443b-b997-a32e82a14605 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1274 microversion: 2.1 time: 0.154062 Jun 06 12:04:12.062477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 12/23] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:11 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:12.079842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:12.080480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:12.096557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:12.097011 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:12.108318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:12.108902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:12.941234 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:12.955488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0c2a9078-70f4-4f3c-8d60-207b1ceb90d1 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.880369 Jun 06 12:04:12.978263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 13/24] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:12 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:13.072606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:13.073626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:13.081622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:13.082296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:13.083403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:13.083993 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:13.251038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:13.263830 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e10f0aee-b8ce-4ce5-961b-5bfbff00888a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1280 microversion: 2.1 time: 0.197616 Jun 06 12:04:13.278942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 14/25] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:13 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:13.573102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:13.975386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:13.976032 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:13.989398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:13.997895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:13.999143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:13.999610 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:14.652477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:14.652477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:14.652979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:14.653265 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:14.653668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:14.678864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:14.679550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:14.686689 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:14.691069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:14.745148 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for project ffaf09bc77914692bb965b55af538141. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:14.750374 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for user 6c904a413f6a4ba49686debac817c70d and project ffaf09bc77914692bb965b55af538141. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:14.788685 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:14.812310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:14.924686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:14.937110 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5df22d69-035a-43a3-a975-3fa34f809848 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.967588 Jun 06 12:04:14.942370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 15/26] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:13 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:14.958341 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3b9a44c4-8ebc-4dcc-8f47-63cb9471e0eb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.695678 Jun 06 12:04:14.962072 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:14.963159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 12/27] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:04:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:04:14.965921 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:14.974524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d7870ac9-9270-4814-8be9-a8beb3fa0552 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:14.977893 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d7870ac9-9270-4814-8be9-a8beb3fa0552 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:14.984200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:14.995523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:14.996794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:14.997257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:15.116607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d7870ac9-9270-4814-8be9-a8beb3fa0552 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:15.125793 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d7870ac9-9270-4814-8be9-a8beb3fa0552 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1237 microversion: 2.1 time: 0.155120 Jun 06 12:04:15.126875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 13/28] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:14 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:15.141953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-682110549", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7652b7b-d4f4-4b94-9492-ad0df97f85c2"}], "security_groups": [{"name": "tempest-securitygroup--1342942733"}], "key_name": "tempest-keypair-811249727", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:15.355054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] validate_networks() for [('f7652b7b-d4f4-4b94-9492-ad0df97f85c2', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:04:15.460344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:15.475666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8ad0372e-ccd5-4e3b-9bd2-8e92610d4250 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.530420 Jun 06 12:04:15.480261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 16/29] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:14 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:15.959832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:15.960841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:15.963627 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:15.980078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:15.984647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:15.986148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:15.987703 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.004184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:16.004857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:16.005386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:16.005982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:16.006495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:16.022156 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.022614 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.023777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.024252 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.036944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=57 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:16.101004 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:16.107103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:16.126806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:16.129800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:16.202240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-daf8b5d1-c5cf-438d-b36b-9875b944b212 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.073801 Jun 06 12:04:16.203163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 14/30] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:04:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:04:16.217366 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:16.229540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-34df2c5f-4e63-43f0-8967-86d2f49d8463 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.274307 Jun 06 12:04:16.229903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:16.230784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:16.241644 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 17/31] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:15 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:16.253911 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.254600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.255653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.256286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.257306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bcd0f75d-88a6-45c9-b8f2-cb30c998e32a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:16.258713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bcd0f75d-88a6-45c9-b8f2-cb30c998e32a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:16.354174 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcd0f75d-88a6-45c9-b8f2-cb30c998e32a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:16.363490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bcd0f75d-88a6-45c9-b8f2-cb30c998e32a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1240 microversion: 2.1 time: 0.117664 Jun 06 12:04:16.366336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 18/32] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:16 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:16.414796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:16.424471 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b438add9-61bf-4be8-a9f6-0022786720bc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1289 microversion: 2.1 time: 0.219812 Jun 06 12:04:16.425585 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 15/33] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:16 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1289 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:16.495911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:16.497352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:16.513038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.513706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.514543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:16.514962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:16.877061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:16.905450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e0542eb1-05e2-4a89-8076-5aef0a58982d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.414167 Jun 06 12:04:16.906354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 19/34] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:16 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:17.248768 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:17.250397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:17.268113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.272682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:17.273786 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.274583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:17.383044 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:17.384825 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:17.401448 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.403331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:17.404706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.405352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:17.706465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:17.723160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e6c5d115-b65f-4a30-974a-27ebc9bc94a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1292 microversion: 2.1 time: 0.343324 Jun 06 12:04:17.742268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 20/35] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:17 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1292 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:17.749870 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:17.750820 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:17.758909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.759608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:17.760756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:17.761436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:18.228600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:18.651502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:18.662262 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ca16f0d8-e70a-409c-9d96-749a79d86f71 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 1.417500 Jun 06 12:04:18.663908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 16/36] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:17 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:18.674176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:18.681211 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:18.681888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:18.688032 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d4fa76f1-3f59-4df1-b787-915ca800843f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.943296 Jun 06 12:04:18.699427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:18.699427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:18.699427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:18.699427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:18.700990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 21/37] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:17 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:18.992832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-e854f0cb-a712-4a6f-8ee7-69054cfae3f3 req-0852ce50-7a61-4a85-bea9-eb66a2d814fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94392213-48bf-4710-b5da-1baad3a6c402", "tag": "0bdc66b8-3317-4a06-9a71-2f45c001a78b"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:19.011384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e854f0cb-a712-4a6f-8ee7-69054cfae3f3 req-0852ce50-7a61-4a85-bea9-eb66a2d814fd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.012211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e854f0cb-a712-4a6f-8ee7-69054cfae3f3 req-0852ce50-7a61-4a85-bea9-eb66a2d814fd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.028326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-e854f0cb-a712-4a6f-8ee7-69054cfae3f3 req-0852ce50-7a61-4a85-bea9-eb66a2d814fd service nova] Creating event network-changed:0bdc66b8-3317-4a06-9a71-2f45c001a78b for instance 94392213-48bf-4710-b5da-1baad3a6c402 on hv-cinder-82549 Jun 06 12:04:19.038803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-e854f0cb-a712-4a6f-8ee7-69054cfae3f3 req-0852ce50-7a61-4a85-bea9-eb66a2d814fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335202 Jun 06 12:04:19.042059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 22/38] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:19.138752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-f481932a-0989-4984-8e9c-068da39a0725 req-a3e2699f-6522-444d-ba6c-7b08427824dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6912d9bb-9d85-4b29-930a-26a7c47e68db", "name": "network-vif-plugged", "status": "completed", "tag": "620d35c5-5cdf-435b-a9e0-1e021dcadaef"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:19.153754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-f481932a-0989-4984-8e9c-068da39a0725 req-a3e2699f-6522-444d-ba6c-7b08427824dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.154390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-f481932a-0989-4984-8e9c-068da39a0725 req-a3e2699f-6522-444d-ba6c-7b08427824dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.175727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-f481932a-0989-4984-8e9c-068da39a0725 req-a3e2699f-6522-444d-ba6c-7b08427824dd service nova] Creating event network-vif-plugged:620d35c5-5cdf-435b-a9e0-1e021dcadaef for instance 6912d9bb-9d85-4b29-930a-26a7c47e68db on hv-cinder-82549 Jun 06 12:04:19.191489 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-f481932a-0989-4984-8e9c-068da39a0725 req-a3e2699f-6522-444d-ba6c-7b08427824dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146265 Jun 06 12:04:19.192756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 23/39] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:19.209262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:19.210003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:19.217791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.218994 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.219936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.220795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.459253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:19.470237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ebd66a4b-7cdb-495e-9804-c7c4d0916ccb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.804582 Jun 06 12:04:19.481188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 17/40] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:18 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:19.488560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-186112793", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b28cd738-01fc-4c76-9f5e-f62fc40b772a"}], "security_groups": [{"name": "tempest-securitygroup--778035606"}], "key_name": "tempest-keypair-498578206", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:19.548521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:19.560295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bac8db0c-8fb5-4d7f-afc2-058f5e2e9718 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1298 microversion: 2.1 time: 0.361087 Jun 06 12:04:19.560893 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 24/41] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:19 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1298 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:19.682318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:19.683098 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:19.689617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.691003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.691937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:19.692509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:19.772668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] validate_networks() for [('b28cd738-01fc-4c76-9f5e-f62fc40b772a', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:04:20.351484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:20.359719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d549d0ad-85f6-4504-b3d5-bfd5e8166ba3 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.683400 Jun 06 12:04:20.360315 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 25/42] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:19 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:20.388524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:20.389149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:20.399144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:20.399945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:20.400986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:20.403392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:20.873480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:20.883330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-04e0ac20-f1ec-406e-b3bb-9605c4b8f6c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.499289 Jun 06 12:04:20.888717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 26/43] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:20 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:20.900129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:20.913566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:20.946292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:20.946868 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:20.948056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:20.948498 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.301761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:21.303215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:21.303879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:21.304431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:21.305242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:21.317330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.318210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.319247 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.319836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.351702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:21.371359 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4fcf9a4f-f7a2-4372-a5dd-5e07240cd644 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.476110 Jun 06 12:04:21.371796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for project e4e76a3125df4436abf5f788e35d492f. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:21.373247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 27/44] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:20 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:21.378102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for user c8bda0c079054e198ffeca4c0ac18bf2 and project e4e76a3125df4436abf5f788e35d492f. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:21.380830 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:21.382784 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:21.394987 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:21.396496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.397226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.397663 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:21.398712 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.447351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.539368 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-65359d6e-ab8d-4bcc-9e90-44a426726a48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.052535 Jun 06 12:04:21.540187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 18/45] 10.222.0.41 () {62 vars in 1187 bytes} [Mon Jun 6 12:04:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 12:04:21.553824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-179ed75b-b038-4468-80f4-5b841c8b60fb req-4c89575d-7f3e-48ee-a561-b8348c51a013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69e9f41-98c3-4137-9c2c-be04ba3fe88e", "tag": "848a22bb-84ee-4d41-ab8a-001e52601be3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:21.583256 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-179ed75b-b038-4468-80f4-5b841c8b60fb req-4c89575d-7f3e-48ee-a561-b8348c51a013 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.583876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-179ed75b-b038-4468-80f4-5b841c8b60fb req-4c89575d-7f3e-48ee-a561-b8348c51a013 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.620349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-179ed75b-b038-4468-80f4-5b841c8b60fb req-4c89575d-7f3e-48ee-a561-b8348c51a013 service nova] Creating event network-changed:848a22bb-84ee-4d41-ab8a-001e52601be3 for instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e on hv-cinder-82549 Jun 06 12:04:21.621075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-179ed75b-b038-4468-80f4-5b841c8b60fb req-4c89575d-7f3e-48ee-a561-b8348c51a013 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 12:04:21.624893 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.625361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.626260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.626693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.638878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.compute.rpcapi [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 12:04:21.641090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117629) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 12:04:21.681371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0473e84e-ccc9-4795-8cf9-c4422c0d94b1 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137869 Jun 06 12:04:21.682041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 19/46] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:21.690913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-e0d20fc3-9326-4b0c-b9e2-03f6bb34a116 req-080a8fd4-cd10-4ca5-aa2f-6dd270c4464f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ad39f5-7b1d-4a44-b425-4742770b160a", "tag": "872b9233-6f23-4c37-93d6-900a553354e5"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:21.705447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e0d20fc3-9326-4b0c-b9e2-03f6bb34a116 req-080a8fd4-cd10-4ca5-aa2f-6dd270c4464f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.706426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e0d20fc3-9326-4b0c-b9e2-03f6bb34a116 req-080a8fd4-cd10-4ca5-aa2f-6dd270c4464f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.727944 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-e0d20fc3-9326-4b0c-b9e2-03f6bb34a116 req-080a8fd4-cd10-4ca5-aa2f-6dd270c4464f service nova] Creating event network-changed:872b9233-6f23-4c37-93d6-900a553354e5 for instance 75ad39f5-7b1d-4a44-b425-4742770b160a on hv-cinder-82549 Jun 06 12:04:21.740708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-e0d20fc3-9326-4b0c-b9e2-03f6bb34a116 req-080a8fd4-cd10-4ca5-aa2f-6dd270c4464f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056252 Jun 06 12:04:21.744640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 20/47] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:21.780158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:21.782548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:21.801322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.802655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:21.804761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:21.807715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:22.047698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.062254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6886693e-ff17-46aa-8aad-1ee9ccf92aa3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.687062 Jun 06 12:04:22.062926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 28/48] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:21 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:22.084423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:22.085252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:22.292711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.315810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.317477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.330336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ad1c8ed4-0c5f-4ed0-8542-0e9d448bc264 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1280 microversion: 2.20 time: 0.255958 Jun 06 12:04:22.341645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 29/49] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:22 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:22.341645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:22.341645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:22.367887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.369436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:22.371935 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:22.374504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:22.376929 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:22.386669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f1a891e5-f199-493d-a1cf-7f72dbcd0128 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.640354 Jun 06 12:04:22.387383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 21/50] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:21 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:22.392160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:22.392940 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:22.409019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:22.409467 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:22.415582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:22.416194 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:22.841597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.846708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:22.857908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cb633b04-8dc5-4846-81c7-02c526bd612f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.468883 Jun 06 12:04:22.859638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 22/51] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:22 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:22.861475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-42e706a6-d625-491e-b2b8-1716ce1c6fad tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.527970 Jun 06 12:04:22.862148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 30/52] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:22 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:23.080583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:23.081739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:23.098113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.104314 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.108689 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.109914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.354280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:23.355176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:23.382113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.385857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.387040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.390660 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.489714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:23.503535 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:23.505123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:23.506258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6d3943e5-a4b8-4599-bd74-3c27ea7f6500 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1340 microversion: 2.20 time: 0.160685 Jun 06 12:04:23.511761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 31/53] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:23 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1340 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:23.517910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:23.526372 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:23.527043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:23.540117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.540371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1e10130d-6189-466d-a42d-efa7ddd89819 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.453659 Jun 06 12:04:23.540595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.541595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.543374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.552595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 23/54] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:23 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:23.880947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:23.881799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:23.883729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:23.892363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.893236 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.894438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.895399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.896600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-61a803b4-1d40-48a0-b5fa-4bea8252a8a7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.383725 Jun 06 12:04:23.897378 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 32/55] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:23 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:23.913416 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:23.914202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:23.922120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.925243 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:23.926101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:23.926546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.263262 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.272551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-367fa92e-c540-408e-bc1e-d690f5dc700c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.398731 Jun 06 12:04:24.273147 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 24/56] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:23 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:24.289324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-8f984186-4958-4f3d-9a87-b8607e7f0030 req-cce7c834-8ea3-4b9e-806a-a233e9a6034e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3895721-6514-401d-aa5d-b36908cf8708", "tag": "fe928e02-5f64-4f96-a62c-91ca4aa8d795"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:24.301879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-8f984186-4958-4f3d-9a87-b8607e7f0030 req-cce7c834-8ea3-4b9e-806a-a233e9a6034e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.302684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-8f984186-4958-4f3d-9a87-b8607e7f0030 req-cce7c834-8ea3-4b9e-806a-a233e9a6034e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.312281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.319012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-8f984186-4958-4f3d-9a87-b8607e7f0030 req-cce7c834-8ea3-4b9e-806a-a233e9a6034e service nova] Creating event network-changed:fe928e02-5f64-4f96-a62c-91ca4aa8d795 for instance c3895721-6514-401d-aa5d-b36908cf8708 on hv-cinder-82549 Jun 06 12:04:24.320939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-75215bb0-b79f-4fab-865d-43bd1e9ef31b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.416209 Jun 06 12:04:24.331032 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 33/57] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:23 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:24.338293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-8f984186-4958-4f3d-9a87-b8607e7f0030 req-cce7c834-8ea3-4b9e-806a-a233e9a6034e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052317 Jun 06 12:04:24.339185 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 25/58] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:24.527021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:24.528491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:24.535287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.535966 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.536899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.537345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.558982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:24.559700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:24.570718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.571245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.572988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.573432 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.644929 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.656685 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.659555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.662042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8379bd75-1844-4f0b-a7f6-99ed9e5e1466 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1350 microversion: 2.20 time: 0.140204 Jun 06 12:04:24.688358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 34/59] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:24 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1350 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:24.784443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:24.796643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-820e035b-bfae-4245-abb1-aca4ca02d305 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.242087 Jun 06 12:04:24.807546 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 26/60] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:24 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:24.914459 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:24.915473 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:24.924274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.925257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:24.926679 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:24.927281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.122268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.130790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-822622cb-777a-4990-9d03-52709411e2fd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.221129 Jun 06 12:04:25.131402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 35/61] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:24 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:25.293143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:25.294132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:25.301166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.301639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.302607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.303369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.339677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:25.340594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:25.354491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.354986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.355773 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.373745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.585788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.595874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f2d8f106-b9e7-4629-90f7-7433860acb0f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.310043 Jun 06 12:04:25.606564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 27/62] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:25 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:25.612109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-5c17f582-d866-4259-87d5-c0231dc3c26e req-a3fcfcc2-987c-4d50-b590-165a503282ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94392213-48bf-4710-b5da-1baad3a6c402", "name": "network-vif-plugged", "status": "completed", "tag": "0bdc66b8-3317-4a06-9a71-2f45c001a78b"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:25.627630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5c17f582-d866-4259-87d5-c0231dc3c26e req-a3fcfcc2-987c-4d50-b590-165a503282ee service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.628069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5c17f582-d866-4259-87d5-c0231dc3c26e req-a3fcfcc2-987c-4d50-b590-165a503282ee service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.638776 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.642164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-5c17f582-d866-4259-87d5-c0231dc3c26e req-a3fcfcc2-987c-4d50-b590-165a503282ee service nova] Creating event network-vif-plugged:0bdc66b8-3317-4a06-9a71-2f45c001a78b for instance 94392213-48bf-4710-b5da-1baad3a6c402 on hv-cinder-82549 Jun 06 12:04:25.647119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-5c17f582-d866-4259-87d5-c0231dc3c26e req-a3fcfcc2-987c-4d50-b590-165a503282ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039276 Jun 06 12:04:25.648022 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 28/63] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:25.649911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-29904072-e366-4db0-bf90-fac769d139e2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.313989 Jun 06 12:04:25.650926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 36/64] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:25 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:25.692737 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:25.693512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:25.701975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.702747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.703698 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.704168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.771880 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.780406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.781937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.783233 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b5f9551d-2345-4bbf-8317-6a8ff5f7e891 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1350 microversion: 2.20 time: 0.095304 Jun 06 12:04:25.783996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 29/65] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:25 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:25.813923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:25.814572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:25.821716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.822754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.823688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:25.824220 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:25.830283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:25.980666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:25.991764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5092a90a-ce7f-4c3a-9bdc-b2d5dde893be tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.181418 Jun 06 12:04:25.992216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 37/66] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:25 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:26.147757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:26.148692 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:26.155242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.155844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.156619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.157044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.321599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:26.338883 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0746ac8e-d582-4cfa-829a-b743a6e84939 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.194849 Jun 06 12:04:26.340775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 30/67] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:26 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:26.613312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:26.613927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:26.621878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.622312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.623116 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.623800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.669098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:26.669711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:26.683998 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.684620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.685550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.692899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.920882 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:26.932091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f372b164-10e8-4ced-b149-75c3442a0e0c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.322653 Jun 06 12:04:26.933453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 38/68] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:26 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:26.944573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:26.948733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:26.965687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.966141 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.967418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:26.968253 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:26.978355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:26.986955 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d3222d7d-bb31-476a-a89e-fb5f2351d3f0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.322289 Jun 06 12:04:26.987979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 31/69] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:26 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:27.015449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:27.017259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:27.026404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.027268 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:27.047389 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.048097 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:27.284830 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:27.296087 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:27.301178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:27.305425 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a6958c9-e4bc-4888-b503-48b18300666c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1338 microversion: 2.20 time: 0.365104 Jun 06 12:04:27.324191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 39/70] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:26 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1338 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:27.359505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:27.360118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:27.366356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.367150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:27.368502 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.369448 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:27.397276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:27.409114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-77045113-fbd3-4d9e-b087-26f59e32d8a6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.399268 Jun 06 12:04:27.409713 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 32/71] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:27 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:27.547515 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:27.558007 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-412dfcca-50f0-4a43-9220-bee1fab7c8b5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.203881 Jun 06 12:04:27.575141 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 40/72] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:27 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:27.951354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:27.963077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:27.971412 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.972439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:27.973414 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:27.973939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.008791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:28.011293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:28.022991 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.037014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.039453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.042144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.209264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.212652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:28.228226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1aeda699-9489-4829-8244-9516ea953136 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.280189 Jun 06 12:04:28.232574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 33/73] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:27 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:28.293005 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.300355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-73ef0b53-a038-4291-9a02-4a27a110e7cb tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.295975 Jun 06 12:04:28.300932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 41/74] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:28 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:28.332056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:28.332825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:28.340525 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.340970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.341767 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.342361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.417113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.425651 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:28.426669 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:28.429147 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.431755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.433524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8fa35114-5710-45d2-bdd6-145924cfee33 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1338 microversion: 2.20 time: 0.105688 Jun 06 12:04:28.434328 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.434459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 34/75] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:28 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:28.435193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.436205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.436839 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.564983 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.572524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-918e3346-0922-44fe-ad77-2d665a15f2af tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.150947 Jun 06 12:04:28.573094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 42/76] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:28 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:28.579449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:28.580176 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:28.586163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.586613 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.588192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:28.588632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:28.719856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:28.727171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-772be489-a0f0-4f1c-a9c7-4ebccb697b3d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1314 microversion: 2.1 time: 0.151419 Jun 06 12:04:28.727743 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 35/77] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:28 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:29.249281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:29.250899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:29.257443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.257898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.259565 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.260024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.319662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:29.320858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:29.329868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.330724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.333125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.333721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.494499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.511466 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-db4eeb79-c84f-4ff3-bdf0-24d2d9b59675 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.265822 Jun 06 12:04:29.512862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 43/78] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:29 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:29.530526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:29.531390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:29.538539 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.539446 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.540750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.541367 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.577505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.586239 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78beb453-03f1-4680-a0fb-776b4c004b94 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.271910 Jun 06 12:04:29.597620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 36/79] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:29 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:29.603901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-53644c14-04e1-470d-ae24-da2d4ae1f964 req-39181952-105b-48b7-9514-410f14aa8876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69e9f41-98c3-4137-9c2c-be04ba3fe88e", "name": "network-vif-plugged", "status": "completed", "tag": "848a22bb-84ee-4d41-ab8a-001e52601be3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:29.608359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:29.615631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-53644c14-04e1-470d-ae24-da2d4ae1f964 req-39181952-105b-48b7-9514-410f14aa8876 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.616413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-53644c14-04e1-470d-ae24-da2d4ae1f964 req-39181952-105b-48b7-9514-410f14aa8876 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.631922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-53644c14-04e1-470d-ae24-da2d4ae1f964 req-39181952-105b-48b7-9514-410f14aa8876 service nova] Creating event network-vif-plugged:848a22bb-84ee-4d41-ab8a-001e52601be3 for instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e on hv-cinder-82549 Jun 06 12:04:29.638511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-53644c14-04e1-470d-ae24-da2d4ae1f964 req-39181952-105b-48b7-9514-410f14aa8876 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038928 Jun 06 12:04:29.639543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 37/80] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:29.648278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:29.649134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:29.653433 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.662595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.663023 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.663539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.664386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.664922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.665080 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.666355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f4939c5e-5b3f-4aa7-996a-e8b1bc9a428d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1338 microversion: 2.20 time: 0.141628 Jun 06 12:04:29.667404 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 44/81] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:29 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1338 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:29.745627 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:29.746240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:29.752865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.753302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.754558 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:29.755326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:29.826530 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.835799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b977ed04-266f-4f58-b84d-5e0fde2cc8c9 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.191924 Jun 06 12:04:29.836840 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 38/82] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:29 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:29.917118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:29.926056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9ae37926-388f-408f-8994-d08a7dc4e68f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1500 microversion: 2.1 time: 0.185542 Jun 06 12:04:29.926889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 45/83] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:29 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1500 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:30.535066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:30.535837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:30.544671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.545534 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.546750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.548056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.608452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:30.609077 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:30.615609 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.616060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.616838 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.617286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.898561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:30.912714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-06f97bf0-f025-4cef-b7d5-02ab33eeb077 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.380747 Jun 06 12:04:30.913320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 39/84] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:30 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:30.922312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:30.923245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:30.933490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:30.937884 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.938339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.940767 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.942167 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.943772 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8e713688-be20-4b12-bd60-13dc242a0be1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.339024 Jun 06 12:04:30.950990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 46/85] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:30 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:30.957853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:30.958666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:30.965668 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.966324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:30.967324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:30.967913 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:31.277575 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:31.286302 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:31.290797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d6c5936c-200f-429d-9a82-ba789a12fb78 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.337626 Jun 06 12:04:31.302734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:31.303343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 47/86] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:30 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:31.307259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:31.309499 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d910c4bd-ed12-4b6f-8356-bf8bfc65964f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.395223 Jun 06 12:04:31.316017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 40/87] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:30 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:31.387412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb4dce6d-1cf9-4295-b535-052f5f145e76"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:31.395006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:31.414816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:31.416397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:31.417351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:31.417942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:31.929741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:31.932491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:31.936803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=20 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:31.937736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=8 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:31.957178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:31.958208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:31.959055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:31.961558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.298735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=30 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:32.419081 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.433709 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-66cb6338-57f4-4579-ae68-498cb7b7eba5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.507821 Jun 06 12:04:32.436647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 41/88] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:31 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:32.444819 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:32.446670 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:32.454664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.455433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.456784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.457445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.501437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ea272f17-d760-4d5e-a1f5-20e985d5a143 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "POST /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.120069 Jun 06 12:04:32.502950 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 48/89] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:04:31 2022] POST /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:32.525729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:32.526774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:32.536188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.536860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.538421 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.543125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.777634 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.787412 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cdc9e468-8900-42ea-b1c4-760f94f324dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.348766 Jun 06 12:04:32.788056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 42/90] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:32 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:32.798964 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:32.799784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:32.806547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.807356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.808337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.808925 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.838410 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.847417 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f986e3ab-e115-4783-9074-e3ec94a6b04f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.343039 Jun 06 12:04:32.858709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 49/91] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:32 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:32.863953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-fd5d4bc9-c9ae-468a-a253-0ea83ab7cf16 req-ee47a179-53b4-4c7a-a095-337a5c50aca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:32.873115 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fd5d4bc9-c9ae-468a-a253-0ea83ab7cf16 req-ee47a179-53b4-4c7a-a095-337a5c50aca1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:32.873564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fd5d4bc9-c9ae-468a-a253-0ea83ab7cf16 req-ee47a179-53b4-4c7a-a095-337a5c50aca1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:32.889854 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-fd5d4bc9-c9ae-468a-a253-0ea83ab7cf16 req-ee47a179-53b4-4c7a-a095-337a5c50aca1 service nova] Creating event network-changed:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:04:32.901448 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-fd5d4bc9-c9ae-468a-a253-0ea83ab7cf16 req-ee47a179-53b4-4c7a-a095-337a5c50aca1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038574 Jun 06 12:04:32.902288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 50/92] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:32.965000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.973418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.974965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:32.978995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-671d0051-3cb1-4c35-b64d-bd3f2b1f3559 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.183671 Jun 06 12:04:32.980036 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 43/93] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:32 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:33.454510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:33.456099 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:33.466586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.467302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.470131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.470786 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.587060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-4a2f7bc6-88c1-4021-96d6-1cc0f2f6ab68 req-72572c67-9a80-4416-9ad4-67928a750f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ad39f5-7b1d-4a44-b425-4742770b160a", "name": "network-vif-plugged", "status": "completed", "tag": "872b9233-6f23-4c37-93d6-900a553354e5"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:33.603406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4a2f7bc6-88c1-4021-96d6-1cc0f2f6ab68 req-72572c67-9a80-4416-9ad4-67928a750f35 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.603828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4a2f7bc6-88c1-4021-96d6-1cc0f2f6ab68 req-72572c67-9a80-4416-9ad4-67928a750f35 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.653663 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-4a2f7bc6-88c1-4021-96d6-1cc0f2f6ab68 req-72572c67-9a80-4416-9ad4-67928a750f35 service nova] Creating event network-vif-plugged:872b9233-6f23-4c37-93d6-900a553354e5 for instance 75ad39f5-7b1d-4a44-b425-4742770b160a on hv-cinder-82549 Jun 06 12:04:33.678596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-4a2f7bc6-88c1-4021-96d6-1cc0f2f6ab68 req-72572c67-9a80-4416-9ad4-67928a750f35 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093201 Jun 06 12:04:33.682330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 44/94] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:33.760336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:33.768120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4026a6bf-eb6f-41bc-9927-1a337027cff4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.318372 Jun 06 12:04:33.768755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 51/95] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:33 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:33.806101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:33.807250 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:33.814483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.815067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.815965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.816500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.865722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:33.869714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:33.877713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.878357 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:33.880883 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:33.881585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:34.094660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:34.113512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1c5909f9-5e6e-4ee2-b1bd-810e556cf9a4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.312027 Jun 06 12:04:34.113861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:34.122030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7221fc00-9827-489a-b108-766a7b707dd0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.260324 Jun 06 12:04:34.122737 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 52/96] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:33 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:34.127358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:34.127955 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:34.132834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 45/97] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:33 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:34.134296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:34.134779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:34.135573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:34.136029 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:34.140457 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:34.281907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:34.290911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:34.292784 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:34.294262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-879dbae8-4287-418a-b9f3-cc8a3d380fc6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.170431 Jun 06 12:04:34.295161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 53/98] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:34 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:34.792177 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:34.793586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:34.805558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:34.807465 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:34.808792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:34.809542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.028773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.040930 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c2a03b28-bce2-40d4-a628-5c84027236a4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.257983 Jun 06 12:04:35.047393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 46/99] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:34 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:35.145988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:35.147386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:35.157711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:35.158472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:35.164276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.169968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.171043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.173759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.174145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.174545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.175667 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.177137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.473204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.477152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.482672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-eaf7b66b-71aa-4252-aab0-0dbd1e2dfc9a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.341512 Jun 06 12:04:35.483602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 54/100] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:35 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:35.487289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-10e1d59e-78b3-4f73-a5b6-eff7cc337a8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.345291 Jun 06 12:04:35.488845 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:35.489653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:35.495325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 47/101] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:35 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:35.496694 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.497208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.498191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:35.498699 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:35.666115 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.674647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.677162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:35.677792 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1ae8c8bb-8b41-4b99-af6a-8f08af38fe45 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.192669 Jun 06 12:04:35.680277 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 55/102] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:35 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:36.059594 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:36.060357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:36.066436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.067068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.067922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.068567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.216565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:36.224784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f5d56940-7c28-464f-87b8-6f4cadff3a56 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1322 microversion: 2.1 time: 0.171089 Jun 06 12:04:36.225311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 48/103] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:36 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:36.500564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:36.501154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:36.505466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:36.506380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:36.507771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.508402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.510217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.510727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.518726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.519315 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.520166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.523231 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.785116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:36.793880 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a10832ab-9983-4839-ac40-04a843b94a76 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.292649 Jun 06 12:04:36.794683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 49/104] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:36 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:36.799728 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:36.800678 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:36.802737 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:36.808113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.809030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.810046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:36.810988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:36.815399 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1d5b234b-74e2-4bb8-a530-af62bd33fb51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.318711 Jun 06 12:04:36.816163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 56/105] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:36 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:36.984583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:36.997434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:37.000848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:37.003483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0057a812-0c87-4792-b240-bf26741760d6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.207375 Jun 06 12:04:37.021620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 50/106] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:36 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:37.241841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:37.242630 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:37.249314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.249887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.250701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.251160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.402122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:37.410490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-01d78980-ccd3-47be-ab06-cb68589bd389 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1517 microversion: 2.1 time: 0.172430 Jun 06 12:04:37.411779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 57/107] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:37 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:37.430175 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:37.433381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:37.441259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.442225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.443249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.443823 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.515813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'flavor' on Instance uuid d69e9f41-98c3-4137-9c2c-be04ba3fe88e {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:04:37.700633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:37.806822 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-55861af2-eb24-46d6-bcfa-7b4865b5e099 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e/action" status: 200 len: 32 microversion: 2.1 time: 0.381840 Jun 06 12:04:37.807445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 51/108] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:04:37 2022] POST /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e/action => generated 32 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 12:04:37.817017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:37.818567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:37.818718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:37.827762 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.828714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.830059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.830153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:37.830241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.836483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.838437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:37.839623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:37.840220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:38.089454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.089710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.099487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-71a6a66b-51fb-4fc2-9683-75d0e135f1c6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.286124 Jun 06 12:04:38.100075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 52/109] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:37 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:38.101491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fe686cb7-658c-4bdf-ad38-f19df1365898 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.293823 Jun 06 12:04:38.104732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 58/110] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:37 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:38.111130 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:38.112099 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:38.113642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:38.116495 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:38.121459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:38.121914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:38.122886 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:38.123628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:38.131712 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:38.132427 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:38.133678 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:38.134877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:38.455800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.458001 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.468965 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.471824 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:38.473559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5f01be0e-ef81-4c9d-9fd2-43de5ef3cee0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.367685 Jun 06 12:04:38.474597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 59/111] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:38 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:38.476101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-11e4b261-843a-4674-88f6-3fd8df6e6538 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1363 microversion: 2.1 time: 0.374969 Jun 06 12:04:38.478977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 53/112] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:38 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:39.121417 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:39.121991 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:39.125129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:39.127681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:39.128944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.129337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.130400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.131033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.141873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.144076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.148014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.151325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.711697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:39.728953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:39.731187 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b3b01684-e694-4165-836b-803a4e674cc6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.614031 Jun 06 12:04:39.732437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 60/113] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:39 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:39.739133 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:39.740301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:39.748513 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.749337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.750780 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.751471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.754754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6a1b12e3-da33-4d2d-a074-c8b4518a300f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.636430 Jun 06 12:04:39.765401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 54/114] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:39 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:39.772296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:39.776020 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:39.784880 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.786310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:39.798533 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:39.800596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.121673 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:40.133030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:40.135160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:40.140309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-baa48925-3b92-413e-a03f-1c0cd538ba7a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.406018 Jun 06 12:04:40.141545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 61/115] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:39 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:40.142104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:40.152185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-8e39118e-e066-4005-be64-5d153f64fe1c req-38cc6a5b-020c-4f01-bfaa-c9e7f6065657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3895721-6514-401d-aa5d-b36908cf8708", "name": "network-vif-plugged", "status": "completed", "tag": "fe928e02-5f64-4f96-a62c-91ca4aa8d795"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:40.154314 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b7ac1bd7-ab78-45c4-95f0-801c9f102f8d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1549 microversion: 2.1 time: 0.396731 Jun 06 12:04:40.155238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 55/116] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:39 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1549 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:40.173726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:40.174511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:40.174947 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8e39118e-e066-4005-be64-5d153f64fe1c req-38cc6a5b-020c-4f01-bfaa-c9e7f6065657 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.175496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8e39118e-e066-4005-be64-5d153f64fe1c req-38cc6a5b-020c-4f01-bfaa-c9e7f6065657 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.182422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.183149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.184212 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.184917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.203155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-8e39118e-e066-4005-be64-5d153f64fe1c req-38cc6a5b-020c-4f01-bfaa-c9e7f6065657 service nova] Creating event network-vif-plugged:fe928e02-5f64-4f96-a62c-91ca4aa8d795 for instance c3895721-6514-401d-aa5d-b36908cf8708 on hv-cinder-82549 Jun 06 12:04:40.210658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-8e39118e-e066-4005-be64-5d153f64fe1c req-38cc6a5b-020c-4f01-bfaa-c9e7f6065657 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066020 Jun 06 12:04:40.211316 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 62/117] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:40.318683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ba389920-6363-4fa9-a03b-317938d10fbc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.149574 Jun 06 12:04:40.319569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 56/118] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:04:40 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:04:40.749861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:40.750885 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:40.757718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.758402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.759345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.759867 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.772952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:40.773592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:40.789667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.790868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:40.794298 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:40.795088 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:41.098158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:41.102190 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:41.112099 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-457336a5-4094-4fd8-bf7e-6b3a8b3355e3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.365480 Jun 06 12:04:41.112258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b5aea16d-4da0-40ee-8a49-8e11d9f8502d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.342950 Jun 06 12:04:41.113141 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 63/119] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:40 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:41.119867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 57/120] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:40 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:41.159829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:41.161079 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:41.169650 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:41.170431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:41.171456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:41.172082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:41.366887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:41.375380 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:41.377031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:41.378392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fc65925b-8c8d-458b-9a5f-f7aa8e41ea28 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.222550 Jun 06 12:04:41.379780 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 64/121] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:41 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:41.712874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-acbb89a9-de1a-4c14-a184-7ff4eff15bba req-2e4ab4f0-52d1-45d9-8e82-49c68a82aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ad39f5-7b1d-4a44-b425-4742770b160a", "tag": "872b9233-6f23-4c37-93d6-900a553354e5"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:41.723715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-acbb89a9-de1a-4c14-a184-7ff4eff15bba req-2e4ab4f0-52d1-45d9-8e82-49c68a82aac1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:41.724303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-acbb89a9-de1a-4c14-a184-7ff4eff15bba req-2e4ab4f0-52d1-45d9-8e82-49c68a82aac1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:41.741917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-acbb89a9-de1a-4c14-a184-7ff4eff15bba req-2e4ab4f0-52d1-45d9-8e82-49c68a82aac1 service nova] Creating event network-changed:872b9233-6f23-4c37-93d6-900a553354e5 for instance 75ad39f5-7b1d-4a44-b425-4742770b160a on hv-cinder-82549 Jun 06 12:04:41.758090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-acbb89a9-de1a-4c14-a184-7ff4eff15bba req-2e4ab4f0-52d1-45d9-8e82-49c68a82aac1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050204 Jun 06 12:04:41.758510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 58/122] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:42.139261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:42.141211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:42.141815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:42.143498 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:42.153881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.170385 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:42.172806 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.174181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.175098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.175905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.176337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.180328 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.181436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.599829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:42.612353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4feba4ee-4a30-4359-98df-fc4ccae64b3a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.477200 Jun 06 12:04:42.613270 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 59/123] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:42 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:42.630707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:42.637861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:42.642918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-519832dd-8a9c-4a9c-b833-8a641fa41f1a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.517030 Jun 06 12:04:42.645149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:42.645559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 65/124] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:42 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:42.657452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.658339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.660074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:42.660875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:42.878484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:42.896582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:42.898882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:42.900465 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cc45b906-870b-4c83-8806-4075aa15007b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.275939 Jun 06 12:04:42.901210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 60/125] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:42 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:43.633312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:43.634860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:43.642805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.643281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:43.644241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.644717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:43.666385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:43.667722 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:43.674676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.675520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:43.676385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.676918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:43.923289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:43.924350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7cb03dc7-caed-4c41-9a0c-ce74428b8714 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.262237 Jun 06 12:04:43.934181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:43.937051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 61/126] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:43 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:43.942034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:43.942646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:43.945898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c418a606-6d1a-4d1a-8fb9-a53f378bd267 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.319107 Jun 06 12:04:43.947619 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 66/127] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:43 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:43.953912 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.954365 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:43.955211 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:43.955645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:44.134879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:44.151511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:44.153119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:44.154241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e14e3b33-51b1-4a7b-87eb-69a5a969a5bc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.216164 Jun 06 12:04:44.155005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 62/128] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:43 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:44.943557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:44.944352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:44.954293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:44.954742 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:44.955832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:44.956341 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:44.972637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:44.974073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:44.995967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:44.998818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:44.999826 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:45.001100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:45.238708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:45.246664 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c2f5a8c7-f016-4983-9160-ced27e9dc4af tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.308862 Jun 06 12:04:45.247488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 67/129] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:44 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:45.252554 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:45.253988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:45.261471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:45.262030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:45.262503 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:45.262908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:45.263402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:45.273056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-821cce3f-0e94-4254-835f-15426ea23713 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.311555 Jun 06 12:04:45.273658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 63/130] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:44 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:45.502869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:45.512145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:45.513834 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:45.515296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6e3f78b4-4628-4735-a9c9-348a517d7840 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.266875 Jun 06 12:04:45.515872 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 68/131] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:45 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:46.266468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:46.267172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:46.273744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.274188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.275489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.275924 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.296862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:46.300865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:46.314613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.315129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.315969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.316577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.500434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:46.510825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-eeabff1a-e4a1-4853-8bb9-0d79c76cc4fd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.248547 Jun 06 12:04:46.522160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 64/132] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:46 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:46.531461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d4b6ceb9-f992-4c33-bfb5-111d2b7b92bb req-467f4330-9565-4cc4-be02-3cdc8a830b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "name": "network-vif-plugged", "status": "completed", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:46.546720 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d4b6ceb9-f992-4c33-bfb5-111d2b7b92bb req-467f4330-9565-4cc4-be02-3cdc8a830b71 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.547566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d4b6ceb9-f992-4c33-bfb5-111d2b7b92bb req-467f4330-9565-4cc4-be02-3cdc8a830b71 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.565286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d4b6ceb9-f992-4c33-bfb5-111d2b7b92bb req-467f4330-9565-4cc4-be02-3cdc8a830b71 service nova] Creating event network-vif-plugged:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:04:46.565716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:46.571427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d4b6ceb9-f992-4c33-bfb5-111d2b7b92bb req-467f4330-9565-4cc4-be02-3cdc8a830b71 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047398 Jun 06 12:04:46.576834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 65/133] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:46.582794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6c6af89f-434e-446b-acbb-08b112eed094 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1366 microversion: 2.1 time: 0.293679 Jun 06 12:04:46.583425 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 69/134] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:46 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:46.585514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:46.586222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:46.598056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.598988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.599911 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:46.600553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:46.742667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:46.751154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:46.752742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:46.753987 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2d012db1-27fe-462b-a063-19ebc9fea1d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.175776 Jun 06 12:04:46.754734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 66/135] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:46 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:47.528089 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:47.528693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:47.535131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.535575 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.536318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.536745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.552054 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:47.601849 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:47.603265 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:47.619859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.623519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.626899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.629901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.725628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:47.740914 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e79e5401-d14d-4419-bd39-8a60821be40c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.216103 Jun 06 12:04:47.741518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 70/136] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:47 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:47.773828 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:47.775510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:47.791127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.792616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.794261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:47.794988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:47.960395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:47.978070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c336582-11ef-4f5c-a1b3-cb4ab24c82ce tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1556 microversion: 2.1 time: 0.380287 Jun 06 12:04:47.982242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 67/137] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:47 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1556 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:47.985394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1684553747", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "networks": [{"uuid": "192aa74e-7a0c-4721-ba14-5e303a5b408f"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:47.993970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.005833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.008170 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.010714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-94f0ae49-bd23-4273-aa63-a9d382f4b0cb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.241495 Jun 06 12:04:48.011614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 71/138] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:47 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:48.017465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:48.018262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:48.026989 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.027984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.029184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.030937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.051041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] validate_networks() for [('192aa74e-7a0c-4721-ba14-5e303a5b408f', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:04:48.076311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:04:48.225057 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e10545eb-767c-44f3-b7de-4297a6df31d0 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 204 len: 0 microversion: 2.1 time: 0.212127 Jun 06 12:04:48.225855 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 72/139] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:04:48 2022] DELETE /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:04:48.231329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:48.231904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:48.237974 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.238418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.239229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.239676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.359860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0b04734b-ade3-42ea-be01-fe16be70f05a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132992 Jun 06 12:04:48.360544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 73/140] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:04:48 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:48.365057 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:48.366155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:48.373412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.373801 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.374561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.375021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.574592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:04:48.575816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:04:48.576343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:04:48.576809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:04:48.577603 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:04:48.588383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.588925 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.589788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.590638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.593162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.598192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:48.602160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4a5c0e58-247c-4875-9c0a-25e39e325cd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.240616 Jun 06 12:04:48.603752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 74/141] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:48 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:48.610810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Getting quotas for project c37ecaa897a7485fb4a2ccdce8496eb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:04:48.627118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Getting quotas for user 05d51a9c4d8e4d869252835c37764abe and project c37ecaa897a7485fb4a2ccdce8496eb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:04:48.641753 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:04:48.644530 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:04:48.697527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-712eb1b8-91af-42f4-91b2-99c4f29aeb51 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716875 Jun 06 12:04:48.698545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 68/142] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:04:48.708594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3e4e64cb-2d80-4eb0-83a1-6bc1db80042e tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:48.709209 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3e4e64cb-2d80-4eb0-83a1-6bc1db80042e tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:48.760444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:48.761438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:48.771336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3e4e64cb-2d80-4eb0-83a1-6bc1db80042e tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.772041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.772657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.774975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:48.775724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:48.781190 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3e4e64cb-2d80-4eb0-83a1-6bc1db80042e tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1214 microversion: 2.1 time: 0.076401 Jun 06 12:04:48.782502 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 75/143] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:48 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:48.944725 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:48.954872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a2c01cd5-1ffd-4d84-b203-1bb5cec61653 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.200950 Jun 06 12:04:48.967014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 69/144] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:48 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:49.030571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:49.031289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:49.039559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.041045 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.042435 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.043033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.187908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:49.197357 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:49.199104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:49.200216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2ca52cfd-8346-4cbd-9ea5-0242bf2907e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.173914 Jun 06 12:04:49.200774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 76/145] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:49 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:04:49.437261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-22b65328-1f36-4199-a270-73bffcf89bc6 req-d72ddc3a-f3af-46ae-84e4-0d045fd267ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3895721-6514-401d-aa5d-b36908cf8708", "tag": "fe928e02-5f64-4f96-a62c-91ca4aa8d795"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:49.454758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-22b65328-1f36-4199-a270-73bffcf89bc6 req-d72ddc3a-f3af-46ae-84e4-0d045fd267ef service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.455127 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-22b65328-1f36-4199-a270-73bffcf89bc6 req-d72ddc3a-f3af-46ae-84e4-0d045fd267ef service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.470784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-22b65328-1f36-4199-a270-73bffcf89bc6 req-d72ddc3a-f3af-46ae-84e4-0d045fd267ef service nova] Creating event network-changed:fe928e02-5f64-4f96-a62c-91ca4aa8d795 for instance c3895721-6514-401d-aa5d-b36908cf8708 on hv-cinder-82549 Jun 06 12:04:49.482820 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-22b65328-1f36-4199-a270-73bffcf89bc6 req-d72ddc3a-f3af-46ae-84e4-0d045fd267ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049131 Jun 06 12:04:49.483452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 70/146] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:49.621394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:49.622123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:49.628805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.629333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.630114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.630555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.770100 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:49.779205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-db34899d-b149-4d6d-aa6e-b663cb221879 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.161980 Jun 06 12:04:49.779808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 77/147] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:49 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:49.799501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:49.800264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:49.807619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.807967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.808897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.809339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.871638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:49.879009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-14dfa658-4917-4098-990e-68a4133a86b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.083991 Jun 06 12:04:49.879586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 71/148] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:49 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:49.974887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:49.975509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:49.982297 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.982762 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:49.983572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:49.984138 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.124250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.131895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4a952c61-dea4-4e85-9091-37d59364bfc2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.160921 Jun 06 12:04:50.132470 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 78/149] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:49 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:50.220179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:50.220796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:50.227232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.227655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.228433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.228878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.380435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.389825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.391521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.392722 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ce889f7e-e33c-490f-ad33-8b22b6530ae0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.176821 Jun 06 12:04:50.393542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 72/150] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:50 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:50.796900 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:50.797505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:50.803833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.804289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.805030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.805446 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.899924 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:50.900937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:50.907930 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.908410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.909238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:50.909700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:50.988514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.995957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:50.996440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-38e6dc02-c01c-4413-8db1-e83448d21855 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.100908 Jun 06 12:04:50.997046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 73/151] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:50 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:51.004148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b23dfd24-f7a3-4306-afd2-0bcffa78bd08 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.211277 Jun 06 12:04:51.004901 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 79/152] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:50 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:51.150172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:51.150823 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:51.156782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:51.157218 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:51.157965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:51.158389 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:51.287304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:51.294751 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1c33c45e-9922-4a7d-b2cb-750ff96745b8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.149199 Jun 06 12:04:51.295348 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 74/153] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:51 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:51.411986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:51.412480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:51.419574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:51.420021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:51.420849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:51.421287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:51.554257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:51.563113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:51.564615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:51.565709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-07d20b99-5f0d-48ce-a30e-d8ef655170aa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1405 microversion: 2.20 time: 0.157818 Jun 06 12:04:51.566269 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 80/154] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:51 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:52.013271 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:52.013878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:52.021737 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:52.022139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.022358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:52.022542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.023345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.023769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.029214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.029666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.030430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.030961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.112996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.122150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d09d2c59-c1e4-4ff0-b095-ed4019a79b60 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.112694 Jun 06 12:04:52.122729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 75/155] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:52 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:52.180478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.189333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-812a3f92-d2b8-4318-abb9-5d2689195092 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.171423 Jun 06 12:04:52.189922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 81/156] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:52 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:52.312825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:52.313430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:52.319866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.320521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.321357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.321981 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.458137 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.466415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-832c477e-f5cf-4cb0-b211-75fe27b05bee tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.157509 Jun 06 12:04:52.467017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 76/157] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:52 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:52.584452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:52.585065 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:52.592037 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.592487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.593248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.593686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.907423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.915558 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.917129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:52.918310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c3a5e5d-f15a-4aa9-be7c-d87a026d4dfd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1597 microversion: 2.20 time: 0.337801 Jun 06 12:04:52.918887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 82/158] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:04:52 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1597 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:04:52.936310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:52.936796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:52.942815 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.943275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:52.944014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:52.944468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.022135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d2703d2c-f66d-425b-ba11-a7a70d04d44a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089606 Jun 06 12:04:53.022719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 77/159] 10.222.0.41 () {60 vars in 1315 bytes} [Mon Jun 6 12:04:52 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:04:53.140069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:53.140695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:53.148045 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.148807 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.149728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.150437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.205880 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:53.206528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:53.212834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.213485 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.214406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.215042 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.248227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:53.256080 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a58e0a82-5883-49bc-9bc3-342630fac576 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.119835 Jun 06 12:04:53.256767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 83/160] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:53 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:04:53.459025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:53.468456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0ca22432-44ba-4027-a472-a2693fd4cab7 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.266506 Jun 06 12:04:53.469536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 78/161] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:53 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:53.483510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:53.484121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:53.489920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.490364 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.491137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:53.491567 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:53.835859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:53.843907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3172360c-fff7-4b81-a267-bab6dced1a48 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.364254 Jun 06 12:04:53.844491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 84/162] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:53 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:54.273355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:54.273894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:54.280902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.281341 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.282109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.282538 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.419241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:54.426825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d9dd6a5c-6672-477c-85cf-c6e5ec72fe4a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.157401 Jun 06 12:04:54.427540 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 79/163] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:54 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:54.485437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:54.486523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:54.494411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.495513 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.496292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.496727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.644939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-82ed7156-968d-465e-b60a-14c7db1321b9 req-b6faded8-3be5-4f0e-9938-a811c7f3ec67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:04:54.650414 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:54.657756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-82ed7156-968d-465e-b60a-14c7db1321b9 req-b6faded8-3be5-4f0e-9938-a811c7f3ec67 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.658203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-82ed7156-968d-465e-b60a-14c7db1321b9 req-b6faded8-3be5-4f0e-9938-a811c7f3ec67 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.671558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-82ed7156-968d-465e-b60a-14c7db1321b9 req-b6faded8-3be5-4f0e-9938-a811c7f3ec67 service nova] Creating event network-changed:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:04:54.672468 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:54.676569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-82ed7156-968d-465e-b60a-14c7db1321b9 req-b6faded8-3be5-4f0e-9938-a811c7f3ec67 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Jun 06 12:04:54.677170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 80/164] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:04:54.681644 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-006f1cc1-c417-469c-befe-40bda1dc6450 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.200001 Jun 06 12:04:54.682288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 85/165] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:54 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:54.861417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:54.862105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:54.868286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.868929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:54.869828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:54.870257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:55.003134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:55.011427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da5ee0d8-64f2-4923-91fd-c164a2df628c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.154138 Jun 06 12:04:55.012347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 81/166] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:54 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:55.444018 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:55.444632 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:55.451494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:55.451941 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:55.452719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:55.453151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:55.519123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:55.521488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:55.528833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3a24e1e5-15b8-44bb-a3ff-48310fa1cd45 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.088789 Jun 06 12:04:55.529413 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 86/167] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:55 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:55.698188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:55.698886 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:55.706355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:55.706796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:55.707588 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:55.708019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:55.845182 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:55.854864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-60bb0bcd-929d-4f4f-a0da-bb713e3bd15d tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.161139 Jun 06 12:04:55.855437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 82/168] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:55 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:56.029506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:56.030154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:56.036971 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.037487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:56.038270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.038711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:56.181690 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:56.190193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-60f88b5b-f73e-4393-8a85-391960facb88 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.165819 Jun 06 12:04:56.190997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 87/169] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:56 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:56.546079 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:56.546761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:56.553238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.553678 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:56.554445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.554894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:56.615821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:56.623604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c5d653e-9604-4928-ac0e-e6a090b433fa tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1218 microversion: 2.1 time: 0.081807 Jun 06 12:04:56.624180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 83/170] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:56 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:56.872432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:56.872968 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:56.879477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.879932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:56.880691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:56.881147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:57.017083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:57.025287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9438e3cb-6a25-4f18-9982-62d7365ea00c tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.157332 Jun 06 12:04:57.025854 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 88/171] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:56 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:57.207404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:57.208074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:57.214321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:57.214769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:57.215558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:57.216021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:57.345819 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:57.354015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78cdefc9-4677-431c-9ee5-188f36465bc9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.150558 Jun 06 12:04:57.354589 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 84/172] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:57 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:57.640471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:57.641090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:57.647270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:57.647753 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:57.648521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:57.648968 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:57.710861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:57.719851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-68f53648-0074-4a67-94a8-bca287bc2d0d tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1210 microversion: 2.1 time: 0.083332 Jun 06 12:04:57.720430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 89/173] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:57 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:58.044342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:58.045269 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:58.052375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.052818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.053644 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.054281 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.191511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:58.201179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4d48cbc0-abf0-462d-8b5c-2779bb64b16a tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.163370 Jun 06 12:04:58.201769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 85/174] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:58 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:58.373533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:58.374164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:58.381046 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.381550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.382592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.383134 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.512785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:58.520258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-916a144b-c607-409e-a5dc-2694b990c5cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.153175 Jun 06 12:04:58.520830 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 90/175] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:58 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:58.737784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:58.738386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:58.740355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:58.741150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:58.746718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.747179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.747929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:58.748358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:58.808197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:58.815560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c7a79ae-6478-4ce8-aab5-526461e02ada tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1210 microversion: 2.1 time: 0.081548 Jun 06 12:04:58.816129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 86/176] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:58 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:59.218303 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:59.218979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:59.220833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:59.226550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.227062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.227967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.228411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.360133 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:59.368138 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-73c61f9a-9d2e-4196-a74e-9fcb791b2f6f tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.153992 Jun 06 12:04:59.369500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 91/177] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:59 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:59.536425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:59.537035 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:59.543847 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.544249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.545005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.545441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.547975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:04:59.680069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:59.689153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-20794b25-4657-4819-ab0e-d4f4eadee561 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.156364 Jun 06 12:04:59.689897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 87/178] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:59 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:04:59.833258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:04:59.833887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:04:59.841180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.842088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.843028 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:04:59.843458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:04:59.905930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:04:59.913789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cb1ef54e-c17f-4a0b-b371-0c41e767ec0c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1210 microversion: 2.1 time: 0.084707 Jun 06 12:04:59.914463 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 92/179] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:04:59 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:00.386127 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:00.386870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:00.393004 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.393439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:00.394178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.394604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:00.535086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:00.542411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-53712213-0249-42ce-ab7e-5ef345d53d54 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.160558 Jun 06 12:05:00.543139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 88/180] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:00 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:00.716014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:00.716896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:00.722934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.723385 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:00.724146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.724579 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:00.867197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:00.876002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1a26b5e2-d301-490c-8637-06027e80daa6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.164126 Jun 06 12:05:00.876575 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 93/181] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:00 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:00.932764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:00.933631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:00.939987 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.940424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:00.941316 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:00.941761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:01.003298 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:01.011239 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f449b385-d2be-422a-b5f1-6f5239927273 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1210 microversion: 2.1 time: 0.083418 Jun 06 12:05:01.011807 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 89/182] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:00 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:01.559635 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:01.560284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:01.566755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:01.567404 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:01.568297 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:01.568757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:01.705756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:01.714377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6db74218-2d6c-4c78-a4b8-7bc8ae0bdd46 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.158892 Jun 06 12:05:01.715144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 94/183] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:01 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:01.892743 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:01.894047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:01.901561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:01.905362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:01.906375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:01.907967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.029002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:02.030241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:02.042023 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:02.042501 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.043410 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:02.044013 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.083956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:02.093621 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fbb1e920-7f66-4dd7-8a80-d71cdd779ea0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.204387 Jun 06 12:05:02.094909 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 90/184] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:01 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:02.130176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:02.141512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bd701e16-37b7-4533-9f93-57e7f1a685e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1274 microversion: 2.1 time: 0.116805 Jun 06 12:05:02.142918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 95/185] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:02 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:02.253965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-b7a445c0-d914-4c35-9e62-f7d0bab47a79 req-f08e4ef2-0edd-4516-9fed-406fe4bb0c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6912d9bb-9d85-4b29-930a-26a7c47e68db", "name": "network-vif-unplugged", "status": "completed", "tag": "620d35c5-5cdf-435b-a9e0-1e021dcadaef"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:02.265512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b7a445c0-d914-4c35-9e62-f7d0bab47a79 req-f08e4ef2-0edd-4516-9fed-406fe4bb0c86 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:02.266304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b7a445c0-d914-4c35-9e62-f7d0bab47a79 req-f08e4ef2-0edd-4516-9fed-406fe4bb0c86 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.278796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-b7a445c0-d914-4c35-9e62-f7d0bab47a79 req-f08e4ef2-0edd-4516-9fed-406fe4bb0c86 service nova] Creating event network-vif-unplugged:620d35c5-5cdf-435b-a9e0-1e021dcadaef for instance 6912d9bb-9d85-4b29-930a-26a7c47e68db on hv-cinder-82549 Jun 06 12:05:02.284108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-b7a445c0-d914-4c35-9e62-f7d0bab47a79 req-f08e4ef2-0edd-4516-9fed-406fe4bb0c86 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034397 Jun 06 12:05:02.284918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 91/186] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:02.734109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:02.734946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:02.741041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:02.741490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.742247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:02.742681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:02.885616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:02.893844 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4bc090ed-f2e2-451f-8136-910486cb8fd5 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1552 microversion: 2.1 time: 0.164095 Jun 06 12:05:02.894424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 96/187] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:02 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:03.116202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:03.117027 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:03.125933 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.126413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.127242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.127739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.161094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:03.161818 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:03.169319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.169886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.170891 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.171454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.255603 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:03.265398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-74bb93fd-261e-4f1c-a47f-dc2890a44de3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1272 microversion: 2.1 time: 0.108755 Jun 06 12:05:03.266003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 97/188] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:03 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:03.270937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-eb7b2742-3ba4-4574-ab24-5a97223f722f req-9a960be8-731d-4915-85ff-75629a727764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6912d9bb-9d85-4b29-930a-26a7c47e68db", "name": "network-vif-deleted", "tag": "620d35c5-5cdf-435b-a9e0-1e021dcadaef"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:03.281964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-eb7b2742-3ba4-4574-ab24-5a97223f722f req-9a960be8-731d-4915-85ff-75629a727764 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.282450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-eb7b2742-3ba4-4574-ab24-5a97223f722f req-9a960be8-731d-4915-85ff-75629a727764 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.296167 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-eb7b2742-3ba4-4574-ab24-5a97223f722f req-9a960be8-731d-4915-85ff-75629a727764 service nova] Creating event network-vif-deleted:620d35c5-5cdf-435b-a9e0-1e021dcadaef for instance 6912d9bb-9d85-4b29-930a-26a7c47e68db on hv-cinder-82549 Jun 06 12:05:03.302390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-eb7b2742-3ba4-4574-ab24-5a97223f722f req-9a960be8-731d-4915-85ff-75629a727764 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034761 Jun 06 12:05:03.303388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 98/189] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:03.334481 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:03.344186 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9f05cf8a-2241-4f35-92bd-356f0d3a1f85 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.235046 Jun 06 12:05:03.344783 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 92/190] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:03 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:03.912359 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:03.913055 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:03.920273 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.920722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.921475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.921908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.954308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:03.954756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:03.955596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lazy-loading 'fault' on Instance uuid 6912d9bb-9d85-4b29-930a-26a7c47e68db {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:04.006769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ba79450153f4399bfe9d3900ed12523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30f4ac789e8e41468a98175ef8d60d18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:04.025127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-10af038f-fad2-48e0-bf75-6f1193c3e77b tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 200 len: 1350 microversion: 2.1 time: 0.116915 Jun 06 12:05:04.025722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 99/191] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:03 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 1350 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:04.283486 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:04.284110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:04.291259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:04.291706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:04.292469 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:04.292961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:04.363984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:04.364445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:04.372337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:04.373034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:04.373622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:04.374068 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:04.473959 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:04.486072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-74306d2a-07c2-4b4b-9aba-0a787d4309cf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.206583 Jun 06 12:05:04.497872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 93/192] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:04 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:04.537616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:04.548798 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fce6e5ee-d10d-4838-8831-a00049b6e3da tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.190075 Jun 06 12:05:04.549496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 100/193] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:04 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:05.046143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:05.046873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:05.054098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.054604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.055467 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.055963 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.072361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] HTTP exception thrown: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Request method failure captured: Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db HTTP/1.1 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0cQPwmxqdVebQD68ZIp9EaRIb57Y7BIckJj3VwfSu52tzG-yK-JzxNdgy4Qm6k2-rAO9r5q8963XSac8mxSMaehakPuY3Mh7eyPtbPWgzl21m2ldEZt5AkMpWnHO86vnnkNVWcrF0lC8Il0bkjASGCNoVixYupIheqj4WkdYKOvbw Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:05:05.077593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_30f4ac789e8e41468a98175ef8d60d18", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 3ba79450153f4399bfe9d3900ed12523 Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.079049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '6912d9bb-9d85-4b29-930a-26a7c47e68db'} Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:05.079868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.081181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.082328 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Returning 404 to user: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:05.082328 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5cec8538-058e-4a3d-88c4-e71d06c16c94 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 404 len: 111 microversion: 2.1 time: 0.039929 Jun 06 12:05:05.082821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 94/194] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:05 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:05.193130 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:05.194078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:05.200794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.201240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.201994 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.202606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.216393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] HTTP exception thrown: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Request method failure captured: Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db/os-volume_attachments HTTP/1.1 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0cQPwmxqdVebQD68ZIp9EaRIb57Y7BIckJj3VwfSu52tzG-yK-JzxNdgy4Qm6k2-rAO9r5q8963XSac8mxSMaehakPuY3Mh7eyPtbPWgzl21m2ldEZt5AkMpWnHO86vnnkNVWcrF0lC8Il0bkjASGCNoVixYupIheqj4WkdYKOvbw Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:05:05.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_30f4ac789e8e41468a98175ef8d60d18", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 3ba79450153f4399bfe9d3900ed12523 Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.223305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '6912d9bb-9d85-4b29-930a-26a7c47e68db'} Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:05.224186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:05.225687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:05.227254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Returning 404 to user: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:05.227254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0cd2fe4d-eb36-48f9-afd4-eebf661bf2dd tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034027 Jun 06 12:05:05.227254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 101/195] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:05:05 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:05.449642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ec5ac792-573d-47c4-ab76-c33f6f12ed4a req-d4172af7-4f23-4a2a-9003-ad7e28cd72a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f480dc77-713d-4dcc-a074-3d2c63fa3447", "tag": "b7d248f6-bd18-479b-921b-ce1a8a9704db"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:05.457964 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ec5ac792-573d-47c4-ab76-c33f6f12ed4a req-d4172af7-4f23-4a2a-9003-ad7e28cd72a5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.458407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ec5ac792-573d-47c4-ab76-c33f6f12ed4a req-d4172af7-4f23-4a2a-9003-ad7e28cd72a5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.470812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ec5ac792-573d-47c4-ab76-c33f6f12ed4a req-d4172af7-4f23-4a2a-9003-ad7e28cd72a5 service nova] Creating event network-changed:b7d248f6-bd18-479b-921b-ce1a8a9704db for instance f480dc77-713d-4dcc-a074-3d2c63fa3447 on hv-cinder-82549 Jun 06 12:05:05.476005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ec5ac792-573d-47c4-ab76-c33f6f12ed4a req-d4172af7-4f23-4a2a-9003-ad7e28cd72a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030174 Jun 06 12:05:05.476611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 95/196] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:05:05.505269 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:05.506027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:05.513731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.514295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.515202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.515645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.566332 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:05.567093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:05.573778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.574325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.575205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:05.575637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:05.688056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:05.696503 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-96739e08-b207-4dfc-b4a3-60c2bc0fc0b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.195836 Jun 06 12:05:05.697248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 102/197] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:05 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:05.735076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:05.742670 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cbcd3499-a5fa-463d-963c-d2129f00c291 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.180871 Jun 06 12:05:05.743286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 96/198] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:05 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:06.428432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:06.428932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:06.436492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.437059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.437922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.438456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.456482 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] HTTP exception thrown: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Request method failure captured: Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db HTTP/1.1 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0cQPwmxqdVebQD68ZIp9EaRIb57Y7BIckJj3VwfSu52tzG-yK-JzxNdgy4Qm6k2-rAO9r5q8963XSac8mxSMaehakPuY3Mh7eyPtbPWgzl21m2ldEZt5AkMpWnHO86vnnkNVWcrF0lC8Il0bkjASGCNoVixYupIheqj4WkdYKOvbw Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:05:06.458728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_30f4ac789e8e41468a98175ef8d60d18", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 3ba79450153f4399bfe9d3900ed12523 Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.460271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '6912d9bb-9d85-4b29-930a-26a7c47e68db'} Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:06.464009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.467147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Returning 404 to user: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:06.467147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-78074e69-c26b-4c77-a82f-78a447f43208 tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 404 len: 111 microversion: 2.1 time: 0.035786 Jun 06 12:05:06.467147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 103/199] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:05:06 2022] DELETE /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:06.470010 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:06.470619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] [instance: 6912d9bb-9d85-4b29-930a-26a7c47e68db] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:06.476833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.477264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.478164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.478568 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.491744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] HTTP exception thrown: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Request method failure captured: Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db HTTP/1.1 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0cQPwmxqdVebQD68ZIp9EaRIb57Y7BIckJj3VwfSu52tzG-yK-JzxNdgy4Qm6k2-rAO9r5q8963XSac8mxSMaehakPuY3Mh7eyPtbPWgzl21m2ldEZt5AkMpWnHO86vnnkNVWcrF0lC8Il0bkjASGCNoVixYupIheqj4WkdYKOvbw Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:05:06.493861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_30f4ac789e8e41468a98175ef8d60d18", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/30f4ac789e8e41468a98175ef8d60d18"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 30f4ac789e8e41468a98175ef8d60d18 Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-DeleteServersTestJSON-1971113822 Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 3ba79450153f4399bfe9d3900ed12523 Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-DeleteServersTestJSON-1971113822-project Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.495500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '6912d9bb-9d85-4b29-930a-26a7c47e68db'} Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:06.499592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. Jun 06 12:05:06.501041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:06.502246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] Returning 404 to user: Instance 6912d9bb-9d85-4b29-930a-26a7c47e68db could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:06.502246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b2d223a0-ecd7-413e-8716-38aa05546cca tempest-DeleteServersTestJSON-1971113822 tempest-DeleteServersTestJSON-1971113822-project] 10.222.0.41 "GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jun 06 12:05:06.502246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 97/200] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:06 2022] GET /compute/v2.1/servers/6912d9bb-9d85-4b29-930a-26a7c47e68db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:06.715318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:06.716571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:06.730397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.730397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.730397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.730397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.761958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:06.762637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:06.784444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.784926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:06.786062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:06.786516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:07.069757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:07.076423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:07.078285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-69b6732e-534d-4bbd-922b-6d2711b57aa1 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.368182 Jun 06 12:05:07.079642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 104/201] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:06 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:07.093276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-afea264c-d104-46cd-8a66-b3f2665131f9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.335905 Jun 06 12:05:07.093844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 98/202] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:06 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:08.096460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:08.097078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:08.104048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:08.104533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:08.105398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:08.105872 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:08.108837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:08.112291 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:08.113562 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:08.121105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:08.122003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:08.123120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:08.123889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:08.335423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:08.346143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e35c0622-0232-43a6-b2bb-b2b1c58259d5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.253850 Jun 06 12:05:08.358149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 105/203] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:08 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:08.383153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:08.393524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7394c142-47b6-4507-be70-80f80acb2d74 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.285763 Jun 06 12:05:08.394402 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 99/204] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:08 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:09.365076 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:09.365738 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:09.373041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:09.373487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:09.374241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:09.374674 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:09.411017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:09.411653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:09.418284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:09.418777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:09.419582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:09.420009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:09.549354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:09.558230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bff6ce9e-269c-4d96-8cdc-d18cb9330011 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.197324 Jun 06 12:05:09.559081 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 106/205] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:09 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:09.583616 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:09.591450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-22f75629-2ea0-40d2-9bb8-c27e71958b9c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.184240 Jun 06 12:05:09.592284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 100/206] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:09 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:10.576970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:10.577482 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:10.584090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:10.584530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:10.585287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:10.585716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:10.609280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:10.609882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:10.616159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:10.616601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:10.617489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:10.617919 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:10.810581 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:10.813875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:10.820646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4f52ca9a-b6e2-4c45-8a93-11746e6368bf tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.247561 Jun 06 12:05:10.822362 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 107/207] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:10 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:10.834652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-87a424bd-2d2b-40a8-a504-3008f2dc3186 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.229270 Jun 06 12:05:10.835286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 101/208] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:10 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:10.863029 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5bef857d-692f-4a9c-949b-82d63fc6b041 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc168122550>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:10.924797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5bef857d-692f-4a9c-949b-82d63fc6b041 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/2b47ad59-f0b9-4916-bfdb-12c72b0abf0b" status: 200 len: 351 microversion: 2.1 time: 0.065674 Jun 06 12:05:10.925402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 108/209] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:05:10 2022] GET /compute/v2.1/os-volumes/2b47ad59-f0b9-4916-bfdb-12c72b0abf0b => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:10.969277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-7f855d89-f041-4bbe-be99-851b5125224d req-f03e7195-5806-456f-b65b-d6ea295708dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480dc77-713d-4dcc-a074-3d2c63fa3447", "name": "network-vif-plugged", "status": "completed", "tag": "b7d248f6-bd18-479b-921b-ce1a8a9704db"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:10.979136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7f855d89-f041-4bbe-be99-851b5125224d req-f03e7195-5806-456f-b65b-d6ea295708dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:10.979977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7f855d89-f041-4bbe-be99-851b5125224d req-f03e7195-5806-456f-b65b-d6ea295708dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:11.003235 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-7f855d89-f041-4bbe-be99-851b5125224d req-f03e7195-5806-456f-b65b-d6ea295708dd service nova] Creating event network-vif-plugged:b7d248f6-bd18-479b-921b-ce1a8a9704db for instance f480dc77-713d-4dcc-a074-3d2c63fa3447 on hv-cinder-82549 Jun 06 12:05:11.014731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-7f855d89-f041-4bbe-be99-851b5125224d req-f03e7195-5806-456f-b65b-d6ea295708dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049334 Jun 06 12:05:11.016017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 102/210] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:11.839745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:11.840351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:11.846644 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:11.847118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:11.847863 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:11.848290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:11.855516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:11.856222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:11.862403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:11.862879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:11.863652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:11.864116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:12.051022 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:12.059330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bf99ebc8-32ed-4e67-99c7-da26944e9803 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1314 microversion: 2.1 time: 0.223893 Jun 06 12:05:12.060526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 109/211] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:11 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:12.063665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:12.072478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0b39ceed-2ef1-46f6-941c-510acf21b1d8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.220995 Jun 06 12:05:12.073221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 103/212] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:11 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:12.307204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f67d7507-da89-4945-a8c4-95625a58ef00 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc16813af70>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:12.354481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f67d7507-da89-4945-a8c4-95625a58ef00 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f0da0603-e6f4-4dfb-ad98-cb1289d5a634" status: 200 len: 351 microversion: 2.1 time: 0.051482 Jun 06 12:05:12.355252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 110/213] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:05:12 2022] GET /compute/v2.1/os-volumes/f0da0603-e6f4-4dfb-ad98-cb1289d5a634 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:13.075034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:13.075652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:13.081627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:13.082075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:13.082833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:13.083289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:13.090310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:13.091050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:13.093321 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:13.099472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:13.099920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:13.100692 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:13.101129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:13.288625 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:13.296825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d1f5276f-3b7c-487e-aab2-b98f50fb1d7c tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1498 microversion: 2.1 time: 0.225676 Jun 06 12:05:13.297592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 104/214] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:13 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1498 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:13.300635 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:13.308135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b06d4ef9-648a-4cb3-9393-a81c1b518f97 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.222619 Jun 06 12:05:13.308786 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 111/215] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:13 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:14.101995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.102600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:14.108621 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.109061 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.109805 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.110268 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.136632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:05:14.189460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:14.230161 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b8a13715-e92e-4d92-8014-e2b936ce2de0 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 204 len: 0 microversion: 2.1 time: 0.131712 Jun 06 12:05:14.230762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 105/216] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:05:14 2022] DELETE /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:05:14.239126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.239722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:14.247177 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.247624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.248521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.248947 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.326317 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.326976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:14.333120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.333560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.334392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:14.334744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:14.388629 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:14.396464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b700c635-fbca-41c8-8d3b-c44cddaf4825 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1504 microversion: 2.1 time: 0.161371 Jun 06 12:05:14.397066 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 112/217] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:14 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:14.473441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:14.481556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3577e823-01ba-4829-badf-bf8ed43500f3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.160373 Jun 06 12:05:14.482122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 106/218] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:14 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:14.770189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e415273b-8271-4675-9959-fdc1830cc698 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc16813ad30>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.819475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e415273b-8271-4675-9959-fdc1830cc698 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8d040105-981e-4d38-b150-57ed3685779a" status: 200 len: 350 microversion: 2.1 time: 0.052888 Jun 06 12:05:14.820049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 113/219] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:05:14 2022] GET /compute/v2.1/os-volumes/8d040105-981e-4d38-b150-57ed3685779a => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:05:14.831220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-60fa462b-fd15-4b6e-936a-9142793ae408 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc1689e7040>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.934398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-60fa462b-fd15-4b6e-936a-9142793ae408 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107024 Jun 06 12:05:14.951734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cad6ef8b-f582-411d-a0f6-12a50b985924 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc1680f3b80>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:14.952260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 107/220] 10.222.0.41 () {58 vars in 1133 bytes} [Mon Jun 6 12:05:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:15.045869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cad6ef8b-f582-411d-a0f6-12a50b985924 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.099230 Jun 06 12:05:15.053827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 114/221] 10.222.0.41 () {58 vars in 1148 bytes} [Mon Jun 6 12:05:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:15.061404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-27156fd5-7fd1-45b4-966b-72a1368558e7 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc168a4ca60>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.147612 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-27156fd5-7fd1-45b4-966b-72a1368558e7 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092173 Jun 06 12:05:15.149254 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 108/222] 10.222.0.41 () {58 vars in 1133 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:15.162372 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bbce382a-bffc-444c-947b-fa6c3fb2f796 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc1680f3e50>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.252332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bbce382a-bffc-444c-947b-fa6c3fb2f796 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092772 Jun 06 12:05:15.252332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 115/223] 10.222.0.41 () {58 vars in 1166 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:15.264047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-28d98b11-a998-4865-a83d-9e228e24bcc6 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc16896b1f0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.350277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-28d98b11-a998-4865-a83d-9e228e24bcc6 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090471 Jun 06 12:05:15.354431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 109/224] 10.222.0.41 () {58 vars in 1169 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:15.367131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9f2600e3-cb89-458d-83cc-d15ea4e6e50d tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc1683340d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.418163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.418975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:15.426012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:15.426445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:15.427247 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:15.427685 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:15.454953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9f2600e3-cb89-458d-83cc-d15ea4e6e50d tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091976 Jun 06 12:05:15.455781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 116/225] 10.222.0.41 () {58 vars in 1154 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:15.466482 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ec742a3-e54e-4924-acaa-e44677a75944 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc1680f33a0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.650962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:15.660566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1a7e91f0-a7d3-40b3-8d2b-ee5942aa9bac tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1504 microversion: 2.1 time: 0.249665 Jun 06 12:05:15.670916 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 110/226] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:15.676068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.676691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:15.683553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:15.684194 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:15.685151 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:15.685722 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:15.707896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6ec742a3-e54e-4924-acaa-e44677a75944 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245010 Jun 06 12:05:15.711793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 117/227] 10.222.0.41 () {58 vars in 1187 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:05:15.721181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e7bf8243-7f63-43ee-bc0f-6837d3461c09 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] Calling method '.version_select at 0x7fc168146700>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:15.871398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:15.881951 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7d2f6165-27b0-425b-ab54-c00bcd884aa1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.209650 Jun 06 12:05:15.882764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 111/228] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:15.948856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e7bf8243-7f63-43ee-bc0f-6837d3461c09 tempest-VolumesTestJSON-1416029435 tempest-VolumesTestJSON-1416029435-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.231843 Jun 06 12:05:15.949610 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 118/229] 10.222.0.41 () {58 vars in 1154 bytes} [Mon Jun 6 12:05:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:16.679069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:16.679845 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:16.686370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:16.686816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:16.687608 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:16.688043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:16.758143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:16.764180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-2a26b5e6-0221-4a8e-819a-3509fd694740 req-387a4b90-0174-45cc-bd3b-08177757d6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f480dc77-713d-4dcc-a074-3d2c63fa3447", "name": "network-vif-deleted", "tag": "b7d248f6-bd18-479b-921b-ce1a8a9704db"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:16.767841 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a738ed4d-dd19-447d-8209-fa0637b439e3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1462 microversion: 2.1 time: 0.092459 Jun 06 12:05:16.774214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-2a26b5e6-0221-4a8e-819a-3509fd694740 req-387a4b90-0174-45cc-bd3b-08177757d6de service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:16.774794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-2a26b5e6-0221-4a8e-819a-3509fd694740 req-387a4b90-0174-45cc-bd3b-08177757d6de service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:16.778200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 112/230] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:16 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:16.788560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-2a26b5e6-0221-4a8e-819a-3509fd694740 req-387a4b90-0174-45cc-bd3b-08177757d6de service nova] Creating event network-vif-deleted:b7d248f6-bd18-479b-921b-ce1a8a9704db for instance f480dc77-713d-4dcc-a074-3d2c63fa3447 on hv-cinder-82549 Jun 06 12:05:16.794069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-2a26b5e6-0221-4a8e-819a-3509fd694740 req-387a4b90-0174-45cc-bd3b-08177757d6de service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034443 Jun 06 12:05:16.794661 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 119/231] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:16.899135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:16.899746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:16.905758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:16.906203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:16.906986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:16.907420 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:17.046375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:17.054165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c0b889ec-73bd-4aa5-be53-cb1f0fed76ed tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.158891 Jun 06 12:05:17.054736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 113/232] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:16 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:17.786616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:17.787398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:17.793789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:17.794235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:17.795023 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:17.795456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:17.860557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:17.868215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8235a71e-b716-4b36-a574-1c5c4ad3cdd6 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1462 microversion: 2.1 time: 0.086217 Jun 06 12:05:17.869291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 120/233] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:17 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:18.072614 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:18.074038 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:18.080382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:18.080824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:18.081593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:18.082026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:18.213855 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:18.221727 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c54cd1ef-c5e4-48f8-891b-59d0cd3993a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.154220 Jun 06 12:05:18.222304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 114/234] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:18 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:18.886913 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:18.887950 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:18.895194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:18.895650 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:18.896439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:18.896880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:18.930518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:18.931123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:18.931656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lazy-loading 'fault' on Instance uuid f480dc77-713d-4dcc-a074-3d2c63fa3447 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:18.973823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:18.982077 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e3893c0-1d3f-496f-8544-582b0a4b8791 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 200 len: 1304 microversion: 2.1 time: 0.099151 Jun 06 12:05:18.982888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 121/235] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:18 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:19.239632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:19.240179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:19.247170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:19.247621 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:19.248393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:19.248829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:19.390423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:19.397717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-39459fe3-8115-45bf-b15a-dbeb39f63fbc tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.162039 Jun 06 12:05:19.398280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 115/236] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:19 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:20.000187 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:20.000811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: f480dc77-713d-4dcc-a074-3d2c63fa3447] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:20.007733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.008182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.008955 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.009535 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.023609 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] HTTP exception thrown: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Request method failure captured: Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 HTTP/1.1 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine1dOrbs1LpSBDPRrgebovor84VFm5QDIpfm_wiZumCURlo9RwGEQRqzMcKX1Hm0_T3B5Mh9QXCM51csVOCtXYFT5lY2dwU5b5LMZ26NFAtYKiahuTLU6ghGQav6cJ_BBC6UaXD-mWv0luHdJJhv7TmVuyVd_h0FPhFihPtA2EhSAcM Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: c37ecaa897a7485fb4a2ccdce8496eb9 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:05:20.026550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c37ecaa897a7485fb4a2ccdce8496eb9", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: c37ecaa897a7485fb4a2ccdce8496eb9 Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesActionsTest-1563921448-project Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 05d51a9c4d8e4d869252835c37764abe Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesActionsTest-1563921448-project Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. Jun 06 12:05:20.028394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'f480dc77-713d-4dcc-a074-3d2c63fa3447'} Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:20.029288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. Jun 06 12:05:20.030371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:20.032563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Returning 404 to user: Instance f480dc77-713d-4dcc-a074-3d2c63fa3447 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:20.033619 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4bd5f7e7-358f-496a-82c8-d38b799e608b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447" status: 404 len: 111 microversion: 2.1 time: 0.037383 Jun 06 12:05:20.037967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 122/237] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:19 2022] GET /compute/v2.1/servers/f480dc77-713d-4dcc-a074-3d2c63fa3447 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:20.150261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1192022146", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "networks": [{"uuid": "192aa74e-7a0c-4721-ba14-5e303a5b408f"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:20.200640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] validate_networks() for [('192aa74e-7a0c-4721-ba14-5e303a5b408f', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:05:20.415615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:20.416529 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:20.423453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.423934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.424709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.425143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.828033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:20.836307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a4b66ea-b8c3-4d88-aa56-a9ae9856cdea tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1523 microversion: 2.1 time: 0.424622 Jun 06 12:05:20.837745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 123/238] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:20 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:20.867003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:05:20.867517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:05:20.868030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:05:20.868432 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:05:20.868898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:05:20.877858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.878296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.879299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:20.879731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:20.897090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Getting quotas for project c37ecaa897a7485fb4a2ccdce8496eb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:05:20.901700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Getting quotas for user 05d51a9c4d8e4d869252835c37764abe and project c37ecaa897a7485fb4a2ccdce8496eb9. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:05:20.914420 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:05:20.917888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:05:20.967865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b50bfa73-8efb-40f5-905e-3822a13ec584 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821352 Jun 06 12:05:20.974135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 116/239] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:05:20.979680 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-448b395e-717c-4378-98fd-01cc541df5df tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:20.980292 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-448b395e-717c-4378-98fd-01cc541df5df tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:21.050992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-448b395e-717c-4378-98fd-01cc541df5df tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:21.060420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-448b395e-717c-4378-98fd-01cc541df5df tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1214 microversion: 2.1 time: 0.084913 Jun 06 12:05:21.060998 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 124/240] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:20 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:21.854710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:21.855653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:21.863122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:21.863579 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:21.864341 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:21.864776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:22.000990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:22.008691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bd38603c-3f95-45d4-b97c-e1b9c15b73b5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1503 microversion: 2.1 time: 0.159119 Jun 06 12:05:22.010684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 117/241] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:21 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:22.026563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:22.027199 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:22.035293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:22.036030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:22.036811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:22.037252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:22.078453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:22.079164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:22.089331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:22.090152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:22.091386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:22.092124 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:22.182457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:22.192830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6422d2d2-d045-4532-bc81-464eb9bdb544 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1274 microversion: 2.1 time: 0.117966 Jun 06 12:05:22.193810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 118/242] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:22 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:22.232835 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:22.240612 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0c1958d0-eeb2-489e-ba3c-4341af949a8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1516 microversion: 2.1 time: 0.218884 Jun 06 12:05:22.241284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 125/243] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:22 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:23.210513 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:23.211318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:23.218631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:23.219067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:23.219982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:23.220417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:23.369651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:23.377191 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b409368c-626b-4f52-aa6c-fabb4da93ec7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.170417 Jun 06 12:05:23.377853 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 119/244] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:23 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:23.812926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-e9c42135-7764-4edc-8fbd-cdc15d7e43b5 req-5886c2e5-4b9c-492c-b8ad-678bd1f0d342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18bc031-6b0e-4379-b7c2-6f3a763ef95b", "tag": "55458016-913b-42ec-85a1-a0fdc8c43184"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:23.822204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e9c42135-7764-4edc-8fbd-cdc15d7e43b5 req-5886c2e5-4b9c-492c-b8ad-678bd1f0d342 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:23.824119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-e9c42135-7764-4edc-8fbd-cdc15d7e43b5 req-5886c2e5-4b9c-492c-b8ad-678bd1f0d342 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:23.842056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-e9c42135-7764-4edc-8fbd-cdc15d7e43b5 req-5886c2e5-4b9c-492c-b8ad-678bd1f0d342 service nova] Creating event network-changed:55458016-913b-42ec-85a1-a0fdc8c43184 for instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b on hv-cinder-82549 Jun 06 12:05:23.848723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-e9c42135-7764-4edc-8fbd-cdc15d7e43b5 req-5886c2e5-4b9c-492c-b8ad-678bd1f0d342 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040052 Jun 06 12:05:23.849329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 126/245] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:05:24.393905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:24.394510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:24.401369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.402055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:24.402890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.403338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:24.550810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:24.559187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7f56c5dc-800b-4d59-836c-f54f64ba5853 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.168882 Jun 06 12:05:24.559760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 120/246] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:24 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:24.747480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:24.748507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:24.754878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.755331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:24.756091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.756524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:24.783048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'flavor' on Instance uuid 94392213-48bf-4710-b5da-1baad3a6c402 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:24.907853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d5e05f00-b6ec-44f9-b212-7b0c66d562cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/action" status: 200 len: 32 microversion: 2.1 time: 0.165177 Jun 06 12:05:24.908499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 127/247] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:05:24 2022] POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 12:05:24.917772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:24.918390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:24.920363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:24.926315 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.926752 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:24.927645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:24.928079 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:25.065187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:25.073218 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9b42f16d-2c03-4f72-a29f-fd989f79580d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.159389 Jun 06 12:05:25.073786 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 121/248] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:24 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:25.577641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:25.578337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:25.585173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:25.585617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:25.586379 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:25.586805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:25.724892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:25.732646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ac809bfb-ba08-454a-b245-3ebebe616146 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.159109 Jun 06 12:05:25.733247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 128/249] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:25 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:26.090545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:26.096813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:26.103125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:26.103574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:26.104341 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:26.104780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:26.242963 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:26.250710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9232f9c2-0cf5-47d2-bd0f-6b4198d6b6b4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.165171 Jun 06 12:05:26.251305 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 122/250] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:26 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:26.750048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:26.750696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:26.757195 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:26.757641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:26.759083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:26.760249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:26.905585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:26.914866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d13b9291-2eaf-4ab8-afb1-d2b7e50b7445 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.168611 Jun 06 12:05:26.915572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 129/251] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:26 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:27.268755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:27.269422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:27.276165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:27.276664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:27.277423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:27.277856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:27.407885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:27.415170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9b356a8a-f458-4017-b536-d9dad9f6dd17 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.150305 Jun 06 12:05:27.415986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 123/252] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:27 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:27.933396 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:27.933971 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:27.947560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:27.948031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:27.948815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:27.949354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:27.971154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:28.149450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:28.157786 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-76a23271-0443-4fa6-bc98-e69a4bd45ecc tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.229857 Jun 06 12:05:28.158373 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 130/253] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:27 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:28.432812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:28.433870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:28.442272 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:28.443191 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:28.443996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:28.444649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:28.602788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:28.613026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-194081fd-d2b2-482b-96ac-114ab9b0e6b1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.184472 Jun 06 12:05:28.614347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 124/254] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:28 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:29.179810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:29.180421 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:29.188353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:29.188827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:29.189584 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:29.190059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:29.322721 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:29.330136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-388daaee-300a-42cb-8935-5720dbd109ee tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.154424 Jun 06 12:05:29.330735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 131/255] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:29 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:29.633848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:29.635228 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:29.641227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:29.641669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:29.642425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:29.642878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:29.769567 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:29.771766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:29.778449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1a261a4f-6dd0-4764-8cb2-13b27e12fb53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.148396 Jun 06 12:05:29.779056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 125/256] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:29 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:30.347293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:30.347938 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:30.354932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:30.355377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:30.356129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:30.356587 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:30.485663 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:30.492896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-084f1d18-08ef-4989-8b08-fc13b1d36309 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.149781 Jun 06 12:05:30.493460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 132/257] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:30 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:30.796524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:30.797164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:30.809597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:30.810054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:30.810824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:30.811288 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:30.888353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:30.909103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:30.948359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:30.955556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d60bd25b-4130-4198-9c91-f1c93d8c43ce tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.163938 Jun 06 12:05:30.956128 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 126/258] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:30 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:31.482477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-0e07babc-8f9f-4a46-9c53-0c846fb4631b req-9a0adc4e-a60e-49e6-a670-701352baf70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18bc031-6b0e-4379-b7c2-6f3a763ef95b", "name": "network-vif-plugged", "status": "completed", "tag": "55458016-913b-42ec-85a1-a0fdc8c43184"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:31.486270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:31.494255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0e07babc-8f9f-4a46-9c53-0c846fb4631b req-9a0adc4e-a60e-49e6-a670-701352baf70e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:31.495040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-0e07babc-8f9f-4a46-9c53-0c846fb4631b req-9a0adc4e-a60e-49e6-a670-701352baf70e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:31.510454 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:31.510917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-0e07babc-8f9f-4a46-9c53-0c846fb4631b req-9a0adc4e-a60e-49e6-a670-701352baf70e service nova] Creating event network-vif-plugged:55458016-913b-42ec-85a1-a0fdc8c43184 for instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b on hv-cinder-82549 Jun 06 12:05:31.511195 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:31.518573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:31.519039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:31.519441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-0e07babc-8f9f-4a46-9c53-0c846fb4631b req-9a0adc4e-a60e-49e6-a670-701352baf70e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038782 Jun 06 12:05:31.520148 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:31.520268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 133/259] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:31.521078 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:31.669765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:31.677990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c6ea0e07-6744-449e-889f-f41b09f05162 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.172233 Jun 06 12:05:31.678626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 127/260] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:31 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:31.973230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:31.974232 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:31.981248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:31.981719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:31.982465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:31.982916 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:32.120680 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:32.128197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-36466150-38d6-48b2-99c4-0f20c09344ef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.159088 Jun 06 12:05:32.128924 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 134/261] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:31 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:32.694791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:32.695437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:32.701854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:32.702294 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:32.703085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:32.703517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:32.839785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:32.847521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5ce272d8-06b6-4ea7-a6c0-bbfd3db4d8c5 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.156546 Jun 06 12:05:32.850902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 128/262] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:32 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:33.145903 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:33.146572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:33.154406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:33.154895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:33.155718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:33.156135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:33.289208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:33.296752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-35177160-c1bd-4d51-9969-fd7c4d0281b7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.154912 Jun 06 12:05:33.297345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 135/263] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:33 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:33.864849 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:33.865455 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:33.872992 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:33.873440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:33.874204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:33.874639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:34.037136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:34.046878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-001b3af7-5844-418b-becd-bdd82fb6e11a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1314 microversion: 2.1 time: 0.185312 Jun 06 12:05:34.048165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 129/264] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:33 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:34.314157 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:34.314774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:34.321282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:34.321734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:34.322864 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:34.323113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:34.463593 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:34.471921 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fbb78198-7c1a-4d3d-bcd4-0a60f21fdabe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.161621 Jun 06 12:05:34.472601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 136/265] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:34 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:35.065415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:35.066145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:35.072762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.073205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.073956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.074383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.212064 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:35.220067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2fc01de2-afa1-4d7e-be7b-910081c7e8b7 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1497 microversion: 2.1 time: 0.158504 Jun 06 12:05:35.220627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 130/266] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:35 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:35.489836 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:35.490445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:35.497933 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.498378 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.499156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.499594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.633178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:35.641735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a49f6d5a-1bc8-48cf-91ac-385b8b7f1e75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.155802 Jun 06 12:05:35.650752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 137/267] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:35 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:35.944987 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:35.945484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:35.952853 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.953303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.954073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:35.954519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:35.980819 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:05:36.059802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b2dafafb-8a84-4787-bcd7-72e847766465 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 204 len: 0 microversion: 2.1 time: 0.118184 Jun 06 12:05:36.062892 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 131/268] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:05:35 2022] DELETE /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:05:36.068563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:36.069383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:36.076175 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:36.076614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:36.077396 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:36.077825 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:36.218957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:36.226401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-24738604-fa96-4cea-a52c-1315f452006b tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1503 microversion: 2.1 time: 0.161695 Jun 06 12:05:36.226988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 138/269] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:36 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:36.661133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:36.662519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:36.669062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:36.669642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:36.670401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:36.670831 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:36.839741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:36.848496 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c68afb84-36a4-4adb-86dd-e979451ab85f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.192993 Jun 06 12:05:36.849079 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 132/270] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:36 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:37.245172 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:37.245797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:37.252349 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:37.252800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:37.253564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:37.253999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:37.381507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:37.389637 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-53da65e8-5ce0-4bee-96a9-ac055775b285 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1503 microversion: 2.1 time: 0.148968 Jun 06 12:05:37.390211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 139/271] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:37 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:37.865684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:37.866875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:37.875731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:37.876346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:37.877742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:37.878329 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:38.024804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:38.033171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ab9a9446-972e-4da5-8a86-aede649beeae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.171474 Jun 06 12:05:38.034044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 133/272] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:37 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:38.311215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-ee48e47a-4d42-4f25-b0ce-c42aee057ac6 req-a88f93fe-646e-45f6-9ba3-c675da0e4442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18bc031-6b0e-4379-b7c2-6f3a763ef95b", "name": "network-vif-deleted", "tag": "55458016-913b-42ec-85a1-a0fdc8c43184"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:38.320463 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-ee48e47a-4d42-4f25-b0ce-c42aee057ac6 req-a88f93fe-646e-45f6-9ba3-c675da0e4442 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:38.320908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-ee48e47a-4d42-4f25-b0ce-c42aee057ac6 req-a88f93fe-646e-45f6-9ba3-c675da0e4442 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:38.332984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-ee48e47a-4d42-4f25-b0ce-c42aee057ac6 req-a88f93fe-646e-45f6-9ba3-c675da0e4442 service nova] Creating event network-vif-deleted:55458016-913b-42ec-85a1-a0fdc8c43184 for instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b on hv-cinder-82549 Jun 06 12:05:38.337970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-ee48e47a-4d42-4f25-b0ce-c42aee057ac6 req-a88f93fe-646e-45f6-9ba3-c675da0e4442 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030523 Jun 06 12:05:38.338577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 140/273] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:38.406781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:38.407490 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:38.414044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:38.414487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:38.415279 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:38.416308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:38.449777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:38.450347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:38.450792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lazy-loading 'fault' on Instance uuid d18bc031-6b0e-4379-b7c2-6f3a763ef95b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:38.498479 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:38.505860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c34f16f7-bbf7-4745-970f-8edfb96dc830 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1304 microversion: 2.1 time: 0.103021 Jun 06 12:05:38.506415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 134/274] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:38 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:39.052252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:39.052959 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:39.059361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:39.059809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:39.060568 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:39.061008 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:39.194408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:39.202609 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-78c485d7-6e55-4249-bdfc-22c4d35c8c3f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.154514 Jun 06 12:05:39.203308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 141/275] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:39 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:39.523006 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:39.523561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:39.530315 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:39.530770 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:39.531558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:39.531991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:39.564012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:39.564462 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:39.564910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lazy-loading 'fault' on Instance uuid d18bc031-6b0e-4379-b7c2-6f3a763ef95b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:39.613015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:39.620586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-049ecdc9-cb2f-4f53-8025-19e38a5b9ac2 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1304 microversion: 2.1 time: 0.101547 Jun 06 12:05:39.621153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 135/276] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:39 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:40.222412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:40.223621 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:40.230451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:40.230929 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:40.231694 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:40.232129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:40.366656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:40.374889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bbeacc73-0eb3-4a6b-b390-c09872928508 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.156708 Jun 06 12:05:40.375453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 142/277] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:40 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:40.637660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:40.638276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:40.644356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:40.644799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:40.645549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:40.645981 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:40.675443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:40.675885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:40.676351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lazy-loading 'fault' on Instance uuid d18bc031-6b0e-4379-b7c2-6f3a763ef95b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:40.716973 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:40.724529 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-63f31fdb-6f6e-4408-bf47-b92e279b49b3 tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1304 microversion: 2.1 time: 0.090869 Jun 06 12:05:40.725087 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 136/278] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:40 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:41.391771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:41.392376 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:41.398799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:41.399274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:41.400025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:41.401362 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:41.537909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:41.545516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c3afac7f-b232-438d-9637-14eb47fb169a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.157578 Jun 06 12:05:41.546089 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 143/279] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:41 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:41.741837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:41.743064 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:41.750007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:41.750442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:41.751224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:41.751684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:41.781938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:41.782376 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:41.782815 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lazy-loading 'fault' on Instance uuid d18bc031-6b0e-4379-b7c2-6f3a763ef95b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:05:41.831940 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05d51a9c4d8e4d869252835c37764abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c37ecaa897a7485fb4a2ccdce8496eb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:41.839666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-733d43cc-ccf3-49fc-a50e-527b16ebd9de tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 200 len: 1304 microversion: 2.1 time: 0.101755 Jun 06 12:05:41.840239 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 137/280] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:41 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:42.563275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:42.564516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:42.571171 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:42.571631 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:42.572750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:42.573187 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:42.703827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:42.711170 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dec345b6-1329-47ed-8679-827775a6d0bf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.151807 Jun 06 12:05:42.711736 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 144/281] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:42 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:42.857478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:42.858206 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] [instance: d18bc031-6b0e-4379-b7c2-6f3a763ef95b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:42.865277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:42.865813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:42.866769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:42.867307 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:42.881003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] HTTP exception thrown: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Request method failure captured: Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b HTTP/1.1 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine1dOrbs1LpSBDPRrgebovor84VFm5QDIpfm_wiZumCURlo9RwGEQRqzMcKX1Hm0_T3B5Mh9QXCM51csVOCtXYFT5lY2dwU5b5LMZ26NFAtYKiahuTLU6ghGQav6cJ_BBC6UaXD-mWv0luHdJJhv7TmVuyVd_h0FPhFihPtA2EhSAcM Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: c37ecaa897a7485fb4a2ccdce8496eb9 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:05:42.882677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c37ecaa897a7485fb4a2ccdce8496eb9", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c37ecaa897a7485fb4a2ccdce8496eb9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: c37ecaa897a7485fb4a2ccdce8496eb9 Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesActionsTest-1563921448 Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesActionsTest-1563921448-project Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 05d51a9c4d8e4d869252835c37764abe Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesActionsTest-1563921448-project Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. Jun 06 12:05:42.884240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'd18bc031-6b0e-4379-b7c2-6f3a763ef95b'} Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:42.885899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. Jun 06 12:05:42.887304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:05:42.888470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] Returning 404 to user: Instance d18bc031-6b0e-4379-b7c2-6f3a763ef95b could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:42.888470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ecb29541-3158-4d9e-af11-d6e681a4614a tempest-VolumesActionsTest-1563921448 tempest-VolumesActionsTest-1563921448-project] 10.222.0.41 "GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b" status: 404 len: 111 microversion: 2.1 time: 0.031793 Jun 06 12:05:42.888470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 138/282] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:42 2022] GET /compute/v2.1/servers/d18bc031-6b0e-4379-b7c2-6f3a763ef95b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:05:43.729342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:43.729976 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:43.732573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=60 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:43.737983 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:43.738428 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:43.739295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:43.739729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:43.873815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:43.881318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3b46bb6e-846d-44fc-9f6a-c7e26d71d92b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.156026 Jun 06 12:05:43.881884 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 145/283] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:43 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:44.898338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:44.898971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:44.904864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:44.905301 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:44.906044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:44.906470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:45.035210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:45.042570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e474b2b9-1bf5-4793-ae61-22aebf5986e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.148104 Jun 06 12:05:45.043160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 139/284] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:44 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:46.058990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:46.059606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:46.067135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:46.067557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:46.068318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:46.068753 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:46.204287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:46.211698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2b589ac3-ddf9-48b9-ba1c-933480d6fc53 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.156569 Jun 06 12:05:46.212584 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 146/285] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:46 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:47.229377 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:47.229982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:47.237105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:47.237550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:47.238306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:47.238739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:47.242693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:47.366616 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:47.374176 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0d8aadc1-54a7-487c-97d2-45b7262d4bdb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.148735 Jun 06 12:05:47.374745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 140/286] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:47 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:48.391233 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:48.391896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:48.398718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:48.399200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:48.399969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:48.400768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:48.526654 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:48.534156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-29ce39e7-2839-41c0-b032-3bb80b3e1183 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.146818 Jun 06 12:05:48.534729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 147/287] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:48 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:49.551866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:49.552482 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:49.559084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:49.559527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:49.560278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:49.560709 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:49.691526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:49.698968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-04c7e852-f9db-436f-a58d-fb3cdc2c587a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.150835 Jun 06 12:05:49.699570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 141/288] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:49 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:50.718478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:50.721071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:50.736563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:50.737018 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:50.741479 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:50.742955 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:50.764202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:51.208309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:51.219415 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4ae6487a-e219-4d0a-b717-d48103f2394f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.506025 Jun 06 12:05:51.220002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 148/289] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:50 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:52.237465 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:52.238487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:52.250689 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.251170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.253858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.255597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.444494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:52.459554 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d61e759d-f601-41dc-8c63-6c967d95b392 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1502 microversion: 2.1 time: 0.225971 Jun 06 12:05:52.481963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c36550ff-7f89-45e9-af1b-2cc61ee5ecd8"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:52.483113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 142/290] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:52 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:52.488775 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:52.502315 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.503475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.509795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.511030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.566077 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] HTTP exception thrown: Cannot 'attach_volume' instance 94392213-48bf-4710-b5da-1baad3a6c402 while it is in vm_state rescued Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Request method failure captured: Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/os-volume_attachments HTTP/1.1 Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 74 Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0sqgscjiYsCiYUYsl0n0mA6SRjuwMz1_ipHPhe-MsEFs5zc4RSb8fbJ0H5qag0P3vEc5Sl_HC8MbYna4KYlh7hF-Yc82-WPWYh2Brs9Lv9UuVLsArj4xFZ2Qj9tQoR5sKk4xyuuVkAd2xge7Clytqv55M2JjnDhXvlRo5hHDT1EnE Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:05:52.567907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cf5de9215c3243e1b2fabc859f102b2a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 473532c21cad4c3492c8425855993b0f Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {"volumeAttachment": {"volumeId": "c36550ff-7f89-45e9-af1b-2cc61ee5ecd8"}} Jun 06 12:05:52.570058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Cannot 'attach_volume' instance 94392213-48bf-4710-b5da-1baad3a6c402 while it is in vm_state rescued Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '94392213-48bf-4710-b5da-1baad3a6c402', 'body': {'volumeAttachment': {'volumeId': 'c36550ff-7f89-45e9-af1b-2cc61ee5ecd8'}}} Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 94392213-48bf-4710-b5da-1baad3a6c402 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:05:52.571336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 94392213-48bf-4710-b5da-1baad3a6c402 while it is in vm_state rescued Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:05:52.573014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:05:52.575383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:05:52.575383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:05:52.575383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 94392213-48bf-4710-b5da-1baad3a6c402 while it is in vm_state rescued Jun 06 12:05:52.575383 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:05:52.577798 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Returning 409 to user: Cannot 'attach_volume' instance 94392213-48bf-4710-b5da-1baad3a6c402 while it is in vm_state rescued {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:05:52.579301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a90c961e-ee08-4874-b7ac-a7877f3becbe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104708 Jun 06 12:05:52.580389 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 149/291] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:05:52 2022] POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/os-volume_attachments => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 12:05:52.589012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:52.590547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:52.597686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.598129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.599104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.599686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.717019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dc05a1bd-f81a-47ad-a171-2f7494ada31c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/action" status: 202 len: 0 microversion: 2.1 time: 0.131689 Jun 06 12:05:52.729282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:52.731785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:52.735277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 143/292] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:05:52 2022] POST /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:05:52.742959 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.743424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.744321 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:52.744761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:52.945947 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:52.962779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a34ef746-a029-4076-b9b0-e149d414a130 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1510 microversion: 2.1 time: 0.238241 Jun 06 12:05:52.963393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 150/293] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:52 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:05:53.982681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:53.983948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:53.992456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:53.992917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:53.993703 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:53.994154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:54.035865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-585337413", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:54.098076 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] validate_networks() for None {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:05:54.431728 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:54.456890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5640d847-7caf-4725-b7ae-0458995acfcb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1510 microversion: 2.1 time: 0.478888 Jun 06 12:05:54.477051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 144/294] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:53 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:54.571819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:05:54.572337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:05:54.573348 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:05:54.573848 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:05:54.575406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:05:54.603658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:54.604539 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:54.607210 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:54.607942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:54.630860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Getting quotas for project a6725c8fde0e4bce93716183772e5dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:05:54.635727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Getting quotas for user 601038b478b6408ab4a8e44ffc2d6cb7 and project a6725c8fde0e4bce93716183772e5dbd. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:05:54.656819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:05:54.664319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:05:54.712811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0faa20aa-76e1-4e3d-9b8c-474bafb79688 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680720 Jun 06 12:05:54.714113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 151/295] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:05:54.725120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6e00076a-7d14-4f79-91b2-da125c82d9e9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:54.726070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6e00076a-7d14-4f79-91b2-da125c82d9e9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:54.791091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6e00076a-7d14-4f79-91b2-da125c82d9e9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:54.800354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6e00076a-7d14-4f79-91b2-da125c82d9e9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1214 microversion: 2.1 time: 0.079247 Jun 06 12:05:54.801407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 145/296] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:54 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:55.496697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:55.497360 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:55.507403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:55.507846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:55.508605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:55.509418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:55.689207 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:55.701381 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6ad4ab4d-0aea-4f41-b9a1-eeed9aa362ae tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1510 microversion: 2.1 time: 0.209623 Jun 06 12:05:55.713830 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 152/297] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:55 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:55.818490 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:55.820304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:55.823760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:05:55.827994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:55.828468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:55.829237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:55.829811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:55.908241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:55.925159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0461abcd-4164-428a-92b3-85d41335178a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1218 microversion: 2.1 time: 0.111307 Jun 06 12:05:55.931556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 146/298] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:55 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:56.725172 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:56.727191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:56.734332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:56.735193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:56.736298 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:56.736890 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:56.914444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:56.935547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bf68baca-8af9-4a8f-bf21-5557243af997 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1510 microversion: 2.1 time: 0.216126 Jun 06 12:05:56.936607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 153/299] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:56 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:56.949543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:56.950415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:56.957394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:56.957852 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:56.958626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:56.959261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:57.048417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:57.056231 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5c12880c-80e3-41a4-b6e7-3e771b644190 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1266 microversion: 2.1 time: 0.112163 Jun 06 12:05:57.056751 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 147/300] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:56 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:57.953422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:57.953994 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:57.960892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:57.961643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:57.962429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:57.963130 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:58.073460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:58.074113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:58.086571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:58.087286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:58.088483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:58.089072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:58.133487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:58.147129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a6ca858-c67b-4ba2-8bd8-373c2cc9dab4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1516 microversion: 2.1 time: 0.197634 Jun 06 12:05:58.148821 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 154/301] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:57 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:58.170049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:58.180214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-325febf7-f08d-4f13-87a8-eca4e47e11af tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1272 microversion: 2.1 time: 0.110517 Jun 06 12:05:58.180942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 148/302] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:58 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:05:59.200575 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:05:59.201315 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:05:59.210499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:59.211336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:59.212324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:59.212950 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:59.583920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-b329c5ed-3d3d-44f3-8b70-682b4eb247a4 req-e81fed46-0d0b-46e2-bf85-0db0276c143d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dfaf0-6ea7-404d-8f55-2f225ae8bd25", "tag": "fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:59.614350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b329c5ed-3d3d-44f3-8b70-682b4eb247a4 req-e81fed46-0d0b-46e2-bf85-0db0276c143d service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:05:59.614953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b329c5ed-3d3d-44f3-8b70-682b4eb247a4 req-e81fed46-0d0b-46e2-bf85-0db0276c143d service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:05:59.653901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-b329c5ed-3d3d-44f3-8b70-682b4eb247a4 req-e81fed46-0d0b-46e2-bf85-0db0276c143d service nova] Creating event network-changed:fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0 for instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 on hv-cinder-82549 Jun 06 12:05:59.673755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-b329c5ed-3d3d-44f3-8b70-682b4eb247a4 req-e81fed46-0d0b-46e2-bf85-0db0276c143d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095690 Jun 06 12:05:59.674702 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 149/303] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:59.703788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f44ce4ef-8cb1-4506-9a79-3c55fe356433 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: .version_select at 0x7fc1689dde50>, body: {"keypair": {"name": "tempest-keypair-1263143092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbbrKJbIEgQ5tXDTU5pxN39UNiUaxt5haZCsDzqxyX/mRibnwAwV3gGSk59maT+Qa9QY44pWLVLl/rSuiImpo6wNBUGs8ZO8fG0Lmlf316SEZaFIHzBFQdys5KlfJ1ISw=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:05:59.743351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-f44ce4ef-8cb1-4506-9a79-3c55fe356433 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:05:59.750735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-f44ce4ef-8cb1-4506-9a79-3c55fe356433 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for user 473532c21cad4c3492c8425855993b0f and project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:05:59.817301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:05:59.827454 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f44ce4ef-8cb1-4506-9a79-3c55fe356433 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128674 Jun 06 12:05:59.830230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 150/304] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:05:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:05:59.832280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bed43445-4ce7-4aba-a4b7-a9bb345930fb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.638395 Jun 06 12:05:59.833395 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 155/305] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:05:59 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:00.849591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:00.850321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:00.860328 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:00.861174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:00.862109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:00.862787 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:01.119381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:01.149037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd7fc08c-1748-4112-8936-aa9ac47e17ba tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.302321 Jun 06 12:06:01.163351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 151/306] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:00 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:01.993091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1345499792", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c811b86e-7c98-4caa-b820-e85c34312902"}], "security_groups": [{"name": "tempest-securitygroup--579720857"}], "key_name": "tempest-keypair-1263143092", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:02.104214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] validate_networks() for [('c811b86e-7c98-4caa-b820-e85c34312902', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:06:02.167179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:02.169283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:02.176586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:02.177033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:02.177986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:02.178577 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:02.456228 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:02.465127 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8697ac9f-ede9-40d1-8a38-8a9fa88e6334 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.302018 Jun 06 12:06:02.466278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 152/307] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:02 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:02.725001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:06:02.725463 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:06:02.725973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:06:02.726379 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:06:02.727001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:06:02.739901 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:02.740360 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:02.741172 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:02.741611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:02.759699 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:06:02.763985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Getting quotas for user 473532c21cad4c3492c8425855993b0f and project cf5de9215c3243e1b2fabc859f102b2a. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:06:02.774968 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:06:02.778150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:06:02.835096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8b243040-2337-421f-952b-062a0c001893 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.846498 Jun 06 12:06:02.835771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 156/308] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:06:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:06:02.846958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c703fec9-7952-4158-9e33-b056a80ee174 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:02.847609 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c703fec9-7952-4158-9e33-b056a80ee174 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:02.909688 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c703fec9-7952-4158-9e33-b056a80ee174 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:02.917266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c703fec9-7952-4158-9e33-b056a80ee174 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1246 microversion: 2.1 time: 0.074811 Jun 06 12:06:02.917849 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 153/309] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:02 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:03.487085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:03.487979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:03.512497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:03.513326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:03.514748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:03.515589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:03.746528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:03.756460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4c15f401-2dd8-409f-9f08-cec49d9cebe2 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.277383 Jun 06 12:06:03.769235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 157/310] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:03 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:03.938932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:03.940222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:03.960101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:03.960691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:03.961915 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:03.962534 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:04.042229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:04.050740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-07a07e82-cbe2-4793-b297-bcdb46519024 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1298 microversion: 2.1 time: 0.120707 Jun 06 12:06:04.054991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 154/311] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:03 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:04.775402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:04.775951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:04.788716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:04.789166 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:04.789944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:04.790377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:04.975885 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:04.984433 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-10199192-88dc-4558-8cd3-97c17afe5533 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.212948 Jun 06 12:06:04.998034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 158/312] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:04 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:05.072923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:05.074938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:05.097364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:05.097812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:05.098614 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:05.099073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:05.237310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:05.247275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c3e3cd37-f518-4217-9982-14deacbaed45 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1304 microversion: 2.1 time: 0.178658 Jun 06 12:06:05.248584 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 155/313] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:05 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:06.002713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:06.003490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:06.015042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:06.015959 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:06.017672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:06.018944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:06.245795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:06.254266 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-74f14bcf-6bd5-454c-93fb-8723c751b9ec tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.255855 Jun 06 12:06:06.268137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 159/314] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:05 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:06.272726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:06.274275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:06.281253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:06.281835 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:06.282856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:06.283779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:06.399678 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-148c0fdd-4328-4592-8136-bf3d1336c955 req-719b5b04-159b-47e5-9df4-9a346425c32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:06.429318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-148c0fdd-4328-4592-8136-bf3d1336c955 req-719b5b04-159b-47e5-9df4-9a346425c32f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:06.430731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-148c0fdd-4328-4592-8136-bf3d1336c955 req-719b5b04-159b-47e5-9df4-9a346425c32f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:06.461525 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-148c0fdd-4328-4592-8136-bf3d1336c955 req-719b5b04-159b-47e5-9df4-9a346425c32f service nova] Creating event network-changed:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:06:06.467858 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-148c0fdd-4328-4592-8136-bf3d1336c955 req-719b5b04-159b-47e5-9df4-9a346425c32f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072921 Jun 06 12:06:06.469428 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 160/315] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:06.557108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:06.567630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bad85619-ffe8-4b30-92d8-3d36b0367a5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.298671 Jun 06 12:06:06.568357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 156/316] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:06 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:07.275612 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:07.277259 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:07.303181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:07.305520 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:07.306782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:07.307693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:07.475770 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:07.489338 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f59fc4df-9d7a-4ca7-bfd8-6ab531e29519 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.219271 Jun 06 12:06:07.500286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 161/317] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:07 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:07.593587 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:07.595499 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:07.606633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:07.607482 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:07.608451 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:07.609658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:07.892099 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:07.905262 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9658202b-fd44-435e-97de-7422125bd258 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.323066 Jun 06 12:06:07.906910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 157/318] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:07 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:07.963777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-052259cb-0bf0-4c3f-8e3b-0f099eb3d394 req-f6648f8a-ac0e-48fb-96d5-4fd8d6c8c806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131dfaf0-6ea7-404d-8f55-2f225ae8bd25", "name": "network-vif-plugged", "status": "completed", "tag": "fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:07.983236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-052259cb-0bf0-4c3f-8e3b-0f099eb3d394 req-f6648f8a-ac0e-48fb-96d5-4fd8d6c8c806 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:07.984408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-052259cb-0bf0-4c3f-8e3b-0f099eb3d394 req-f6648f8a-ac0e-48fb-96d5-4fd8d6c8c806 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:08.009732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-052259cb-0bf0-4c3f-8e3b-0f099eb3d394 req-f6648f8a-ac0e-48fb-96d5-4fd8d6c8c806 service nova] Creating event network-vif-plugged:fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0 for instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 on hv-cinder-82549 Jun 06 12:06:08.018140 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-052259cb-0bf0-4c3f-8e3b-0f099eb3d394 req-f6648f8a-ac0e-48fb-96d5-4fd8d6c8c806 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058942 Jun 06 12:06:08.021329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 162/319] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:08.507741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:08.508418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:08.515583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:08.516043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:08.516819 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:08.517458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:08.695750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:08.706957 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fe4db74c-72a9-47f7-a6b8-757ea9bb24d1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.201057 Jun 06 12:06:08.708342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 158/320] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:08 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:08.930587 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:08.932416 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:08.940679 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:08.941399 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:08.942567 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:08.943093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:09.140737 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:09.149973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6d335c7a-b1ce-4cf1-91f9-e5a32582f093 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.230016 Jun 06 12:06:09.163139 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 163/321] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:08 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:09.726412 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:09.727050 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:09.733615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:09.734062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:09.734817 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:09.735275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:09.750113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:09.868436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:09.876326 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1266d783-135a-4044-8f03-1756cb598d59 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.153984 Jun 06 12:06:09.876942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 159/322] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:09 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:10.166339 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:10.166880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:10.173436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:10.173878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:10.174626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:10.175094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:10.305221 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:10.313136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6508c5b8-102a-418d-8f51-189a2dbe2662 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.150697 Jun 06 12:06:10.313703 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 164/323] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:10 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:10.893263 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:10.893880 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:10.899988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:10.900440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:10.901211 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:10.901657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:11.043520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:11.051252 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-710a8fc5-bfee-4001-b1c5-ce5b219b8069 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.161707 Jun 06 12:06:11.051816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 160/324] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:10 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:11.330529 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:11.331169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:11.337646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:11.338092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:11.338876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:11.339313 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:11.476358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:11.484579 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-833128ad-da5b-494d-90ee-42a00ee51acd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.157805 Jun 06 12:06:11.485155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 165/325] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:11 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:12.068520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:12.069122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:12.076116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:12.076556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:12.077303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:12.077732 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:12.205798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:12.213130 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-13b7d4c7-b34b-4028-9ed8-1f0038841685 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.148414 Jun 06 12:06:12.213686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 161/326] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:12 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:12.502576 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:12.503288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:12.509931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:12.510456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:12.511312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:12.513285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:12.647171 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:12.654999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-03382927-95ab-4f14-b5b4-67a33c4ecc4f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.156598 Jun 06 12:06:12.655585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 166/327] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:12 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:13.231436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:13.232067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:13.233962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=8 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:13.239585 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:13.240024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:13.240780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:13.241205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:13.378116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:13.386673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-816ce5f2-c577-457e-ae2b-ca9620addc21 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1314 microversion: 2.1 time: 0.159630 Jun 06 12:06:13.387277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 162/328] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:13 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:13.675630 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:13.676249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:13.678176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:13.679121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=12 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:13.686815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:13.687314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:13.688095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:13.688675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:13.851278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:13.858987 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-18644d0d-93bc-43a2-baa2-35321893de63 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.187290 Jun 06 12:06:13.859640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 167/329] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:13 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:14.409422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:14.410315 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:14.416466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.416905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.420194 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.420777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.556286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:14.564448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-709b3461-09d2-44e3-82f0-985ee7510697 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1464 microversion: 2.1 time: 0.158934 Jun 06 12:06:14.565037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 163/330] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:14 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:14.603986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:14.604491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:14.606856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:14.612608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.613052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.613811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.614243 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.619024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:14.640458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:06:14.712645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-36b16bc7-5bd1-4bfd-9995-74b80af31c53 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 204 len: 0 microversion: 2.1 time: 0.112188 Jun 06 12:06:14.713275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 168/331] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:06:14 2022] DELETE /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:06:14.721993 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:14.722595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:14.728532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.729002 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.729759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.730306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.860636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:14.868119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aac1ac7d-4ce4-491c-bce6-64cfae6043f3 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.150215 Jun 06 12:06:14.868675 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 164/332] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:14 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:14.876598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:14.877286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:14.883255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.883701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:14.884450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:14.884881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:15.011308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:15.018736 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2739e20f-de88-421e-9b00-1fa40f3839e4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.146312 Jun 06 12:06:15.019339 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 169/333] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:14 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:15.885259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:15.885867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:15.892132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:15.892580 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:15.893345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:15.893780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:16.027779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:16.037428 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:16.038058 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3fdc33c3-61bc-45a6-ab57-b7c7a4d25bf0 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.155856 Jun 06 12:06:16.038149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 165/334] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:15 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:16.038486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:16.046509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:16.046985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:16.047751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:16.048178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:16.176332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:16.185460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bf7cef81-5076-45b5-9f65-73f80e9a731a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.153172 Jun 06 12:06:16.186025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 170/335] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:16 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:17.061299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:17.061908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:17.069680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:17.070133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:17.070957 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:17.071431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:17.202025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:17.202905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:17.207248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:17.209353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:17.209806 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:17.210573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:17.211042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:17.215171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bbc260bb-c444-42b1-9c32-4e4edb680838 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.160216 Jun 06 12:06:17.215789 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 166/336] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:17 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:17.343410 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:17.352982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a51c27cb-05d6-4eb5-9823-a5ddc146c522 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.155355 Jun 06 12:06:17.353567 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 171/337] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:17 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:18.233421 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:18.233933 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:18.240303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:18.240747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:18.241508 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:18.241938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:18.370282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:18.371031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:18.376066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:18.377838 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:18.378282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:18.379068 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:18.379501 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:18.383540 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-be5710fd-973c-4867-8e86-629259b78686 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.154668 Jun 06 12:06:18.384098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 167/338] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:18 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:18.511069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:18.518521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f5fbe693-87e6-41c9-b542-3cf39f1c579e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.152034 Jun 06 12:06:18.519122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 172/339] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:18 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:19.400319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:19.401000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:19.407435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:19.407877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:19.408653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:19.409080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:19.536729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:19.537344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:19.537449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:19.544051 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:19.544506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:19.544969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2190329a-f8c0-4dc8-b147-e9e4a96a41d9 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.148763 Jun 06 12:06:19.545274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:19.545531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 168/340] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:19 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:19.545708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:19.676532 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:19.684522 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf611c57-ed5e-4bfd-b786-9f3b4d5ee374 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.151931 Jun 06 12:06:19.685083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 173/341] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:19 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:20.562526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:20.563155 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:20.569241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:20.569681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:20.570425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:20.570927 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:20.701474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:20.702093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:20.703336 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:20.708646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:20.709096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:20.709862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:20.710300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:20.710774 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a5aca46e-025c-4d8c-88f7-7e32bd5c6feb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.152177 Jun 06 12:06:20.711400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 169/342] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:20 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:20.840485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:20.848103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd61fae0-2e96-40a7-b784-62e69967c38c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.151133 Jun 06 12:06:20.848667 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 174/343] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:20 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:21.729192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:21.729802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:21.736046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:21.736490 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:21.737249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:21.737680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:21.864800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:21.865423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:21.867949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:21.872764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:21.873213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:21.873973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:21.874416 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:21.876149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-61f3fc8c-13ac-4ff4-90be-5bd90ef67ca1 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.150791 Jun 06 12:06:21.876915 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 170/344] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:21 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:22.004681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:22.012521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f07fda6a-4eaa-4b9d-8ca8-e3616d28c6cb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.151546 Jun 06 12:06:22.013095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 175/345] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:21 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:22.893380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:22.893991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:22.900221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:22.900676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:22.901437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:22.901876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:23.028992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:23.029604 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:23.036081 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:23.036527 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:23.037289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:23.037417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:23.037717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:23.048045 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99647e33-ba4f-4458-9f62-2c3ef6cb5908 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.158495 Jun 06 12:06:23.048633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 171/346] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:22 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:23.179958 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:23.188051 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-db8c574a-1c6c-448e-8b7e-47bf7db88c77 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.163385 Jun 06 12:06:23.188612 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 176/347] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:23 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:23.331214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-73ec6c8c-4a05-45f1-a9e4-c4df3f3fa79c req-fff828b1-46c9-4f5d-876a-f53ed0386810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "name": "network-vif-plugged", "status": "completed", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:23.339541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-73ec6c8c-4a05-45f1-a9e4-c4df3f3fa79c req-fff828b1-46c9-4f5d-876a-f53ed0386810 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:23.340634 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-73ec6c8c-4a05-45f1-a9e4-c4df3f3fa79c req-fff828b1-46c9-4f5d-876a-f53ed0386810 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:23.353254 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-73ec6c8c-4a05-45f1-a9e4-c4df3f3fa79c req-fff828b1-46c9-4f5d-876a-f53ed0386810 service nova] Creating event network-vif-plugged:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:06:23.358669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-73ec6c8c-4a05-45f1-a9e4-c4df3f3fa79c req-fff828b1-46c9-4f5d-876a-f53ed0386810 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031349 Jun 06 12:06:23.359461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 172/348] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:24.065534 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:24.066143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:24.072733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:24.073188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:24.073946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:24.075205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:24.205780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:24.207253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:24.208802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:24.213529 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:24.213969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:24.214726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:24.215290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:24.216876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7e2331f3-8b3a-4d62-991e-4aab0d5eb762 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.155152 Jun 06 12:06:24.217580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 177/349] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:24 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:24.349717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:24.357896 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e4ae12b8-1da9-4689-9063-8c4ee9ce8fef tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.156323 Jun 06 12:06:24.358460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 173/350] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:24 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:25.234431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:25.235182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:25.242827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:25.243308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:25.244085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:25.244518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:25.374559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:25.375221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:25.379593 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:25.381434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:25.381860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:25.382627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:25.383265 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:25.390731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a2b2538e-8be0-4d6f-a681-9d309645fe69 tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1470 microversion: 2.1 time: 0.160979 Jun 06 12:06:25.391369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 178/351] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:25 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:25.563706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:25.573690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a111fade-4970-4a97-8623-ee760cf7d977 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1371 microversion: 2.1 time: 0.202814 Jun 06 12:06:25.584228 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 174/352] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:25 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:06:25.942138 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-1406d0c8-07a6-4e26-ad75-f70cd60b0112 req-a43a44cc-9a8e-4db9-a987-7c257c33cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131dfaf0-6ea7-404d-8f55-2f225ae8bd25", "name": "network-vif-deleted", "tag": "fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:25.952352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1406d0c8-07a6-4e26-ad75-f70cd60b0112 req-a43a44cc-9a8e-4db9-a987-7c257c33cd29 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:25.952804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1406d0c8-07a6-4e26-ad75-f70cd60b0112 req-a43a44cc-9a8e-4db9-a987-7c257c33cd29 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:25.967129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-1406d0c8-07a6-4e26-ad75-f70cd60b0112 req-a43a44cc-9a8e-4db9-a987-7c257c33cd29 service nova] Creating event network-vif-deleted:fe1b7f89-5ea3-4584-b5dd-4b80eec6aeb0 for instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 on hv-cinder-82549 Jun 06 12:06:25.972749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-1406d0c8-07a6-4e26-ad75-f70cd60b0112 req-a43a44cc-9a8e-4db9-a987-7c257c33cd29 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035659 Jun 06 12:06:25.973379 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 179/353] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:26.408876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:26.409654 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:26.411934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:26.417474 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.418415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.419452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.419660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.489096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '601038b478b6408ab4a8e44ffc2d6cb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6725c8fde0e4bce93716183772e5dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:26.497915 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-88b887c2-2260-4d19-9ac9-cb7a4369ab5a tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 200 len: 1299 microversion: 2.1 time: 0.093295 Jun 06 12:06:26.498491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 175/354] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:26 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:26.592643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:26.593995 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:26.601025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.601474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.602249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.602685 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.740331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:06:26.747755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d8d3656-0a58-4815-94ed-82adcbdacf75 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1565 microversion: 2.1 time: 0.159530 Jun 06 12:06:26.748361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 180/355] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:26 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:06:26.764230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:26.764728 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:26.771352 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.771824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.772598 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:26.773031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:26.852893 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8524051f-e22c-4f58-bb8f-9658d2ecc2e0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092843 Jun 06 12:06:26.853491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 176/356] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:06:26 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:27.515822 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:06:27.516430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] [instance: 131dfaf0-6ea7-404d-8f55-2f225ae8bd25] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:06:27.522484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:27.522962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:27.523717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:27.524146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:27.537282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] HTTP exception thrown: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Request method failure captured: Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 HTTP/1.1 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine2fh_Z2mWzLoy7rXDvnzm69FqkhFo77X0Zei4JzC31d0OGzuPYz8NtTvRUpfyNlx3o3wa4EpkWFwc3npGZoB6M1H-EFZA0tPGHSiH_9bt7QngouWqKairyA2OCFZW57Yb63YmEcUC1N71bxJjtr51_WTZSkR6CgDXHf1oynFAUeVA0 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: a6725c8fde0e4bce93716183772e5dbd Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesNegativeTest-2133188292 Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:06:27.538930 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a6725c8fde0e4bce93716183772e5dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_a6725c8fde0e4bce93716183772e5dbd", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/a6725c8fde0e4bce93716183772e5dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/a6725c8fde0e4bce93716183772e5dbd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesNegativeTest-2133188292 Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: a6725c8fde0e4bce93716183772e5dbd Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesNegativeTest-2133188292 Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesNegativeTest-2133188292-project Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 601038b478b6408ab4a8e44ffc2d6cb7 Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesNegativeTest-2133188292-project Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. Jun 06 12:06:27.540471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '131dfaf0-6ea7-404d-8f55-2f225ae8bd25'} Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:06:27.541391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. Jun 06 12:06:27.542790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:06:27.544058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] Returning 404 to user: Instance 131dfaf0-6ea7-404d-8f55-2f225ae8bd25 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:06:27.544058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6893c340-90a3-477e-bcc9-1794e8147cbb tempest-VolumesNegativeTest-2133188292 tempest-VolumesNegativeTest-2133188292-project] 10.222.0.41 "GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25" status: 404 len: 111 microversion: 2.1 time: 0.029526 Jun 06 12:06:27.544058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 181/357] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:06:27 2022] GET /compute/v2.1/servers/131dfaf0-6ea7-404d-8f55-2f225ae8bd25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:06:28.072210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-278e51a4-19e1-420e-8695-c650dae28bc5 req-75283112-7793-460e-bde8-16aba0cf2659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:28.081005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-278e51a4-19e1-420e-8695-c650dae28bc5 req-75283112-7793-460e-bde8-16aba0cf2659 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:06:28.081574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-278e51a4-19e1-420e-8695-c650dae28bc5 req-75283112-7793-460e-bde8-16aba0cf2659 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:06:28.086273 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:28.110484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-278e51a4-19e1-420e-8695-c650dae28bc5 req-75283112-7793-460e-bde8-16aba0cf2659 service nova] Creating event network-changed:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:06:28.118859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-278e51a4-19e1-420e-8695-c650dae28bc5 req-75283112-7793-460e-bde8-16aba0cf2659 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050538 Jun 06 12:06:28.120423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 177/358] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:06:47.330461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:47.331204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:06:47.512720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-078e7113-4196-4453-9157-3166c9c8b41c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Action: 'create', calling method: .version_select at 0x7fc168231790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1133469723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuNaSLN952ej3OPfJgLvB3C1JvUIwQQNyWoEZtGhKdPbiU+n+J81yGZHkvrGkhBdi7rXZZXgn5+g66c4lxh6XkiWxnV7GzPrc54wTRpB8Jx18szP5drDMgwN6q0k+9RNw=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:06:47.526601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-078e7113-4196-4453-9157-3166c9c8b41c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Getting quotas for project 43703500ab064d7091826ea7870273fb. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:06:47.530990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-078e7113-4196-4453-9157-3166c9c8b41c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Getting quotas for user 567389c79da54aec809e004e4bde99e5 and project 43703500ab064d7091826ea7870273fb. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:06:47.554174 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-078e7113-4196-4453-9157-3166c9c8b41c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.228709 Jun 06 12:06:47.554781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 182/359] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:06:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:13.591361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=5 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:13.593308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:13.779212 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-09b54ebe-17ba-44e9-b042-26974295a1f5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Action: 'create', calling method: .version_select at 0x7fc1680ea310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2130326679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBq8VRUd89Lsvrx5ljObIwpO9xxMKfWCebW0EPjmK8lxVdeGVoWf9DIL/kUeRcrTlqfF+sLC0fjX5EBhH/cnNBarWTAm+cDIEbGbN4NImL4KeIQzLAa5IAm1PtRyT0AF8g=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:13.795034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-09b54ebe-17ba-44e9-b042-26974295a1f5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for project c80560ca253e41239020e2c008a9b3ba. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:07:13.799456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-09b54ebe-17ba-44e9-b042-26974295a1f5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for user adb92379209e46e79de4df370183fa8a and project c80560ca253e41239020e2c008a9b3ba. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:07:13.823145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-09b54ebe-17ba-44e9-b042-26974295a1f5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.232854 Jun 06 12:07:13.823750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 178/360] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:07:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:16.589487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:16.591333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:16.600258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-707124616", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1133469723", "security_groups": [{"name": "tempest-secgroup-smoke-1013281758"}], "networks": [{"uuid": "64c92204-12d0-4339-a27d-4df845d995ba"}], "block_device_mapping_v2": [{"uuid": "e682a70e-94a6-4079-874f-61fe3a9bf764", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:16.723165 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] validate_networks() for [('64c92204-12d0-4339-a27d-4df845d995ba', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:07:17.153052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:07:17.153478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:07:17.153949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:07:17.154406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:07:17.154816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:07:17.163803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:17.164495 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:17.165291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:17.165725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:17.184581 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Getting quotas for project 43703500ab064d7091826ea7870273fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:07:17.189319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Getting quotas for user 567389c79da54aec809e004e4bde99e5 and project 43703500ab064d7091826ea7870273fb. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:07:17.254704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:07:17.256829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e682a70e-94a6-4079-874f-61fe3a9bf764',volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:07:17.397844 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2122f768-aa4f-4ae0-818d-34ae83a9f4e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810273 Jun 06 12:07:17.398475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 183/361] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:07:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:07:17.409984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-68787193-29f9-4030-b763-9942f79396e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:17.410717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-68787193-29f9-4030-b763-9942f79396e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:17.485785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-68787193-29f9-4030-b763-9942f79396e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:17.500450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-68787193-29f9-4030-b763-9942f79396e2 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1088 microversion: 2.1 time: 0.094575 Jun 06 12:07:17.501179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 179/362] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:17 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:18.519082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:18.519589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:18.525643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:18.526082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:18.526824 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:18.527275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:18.593034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:18.600691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6fe01fef-9a14-4e2f-b8e8-ea6e1709a0cf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1186 microversion: 2.1 time: 0.086983 Jun 06 12:07:18.601280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 184/363] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:18 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:19.618276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:19.619505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:19.627263 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:19.628070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:19.628871 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:19.629320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:19.818673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:19.835785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3ac7c77a-b7d8-4242-a342-78714351f518 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1272 microversion: 2.1 time: 0.221577 Jun 06 12:07:19.836655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 180/364] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:19 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:20.475887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-10aa3dab-0b57-4e26-b740-e79f62ee8b4a req-2aff9e1d-8411-482c-ab61-fc2d767d4aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:20.488616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-10aa3dab-0b57-4e26-b740-e79f62ee8b4a req-2aff9e1d-8411-482c-ab61-fc2d767d4aaa service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:20.489061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-10aa3dab-0b57-4e26-b740-e79f62ee8b4a req-2aff9e1d-8411-482c-ab61-fc2d767d4aaa service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:20.503421 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-10aa3dab-0b57-4e26-b740-e79f62ee8b4a req-2aff9e1d-8411-482c-ab61-fc2d767d4aaa service nova] Creating event network-changed:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:07:20.516282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-10aa3dab-0b57-4e26-b740-e79f62ee8b4a req-2aff9e1d-8411-482c-ab61-fc2d767d4aaa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043955 Jun 06 12:07:20.519029 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 185/365] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:20.858812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:20.859460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:20.865565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:20.866002 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:20.866753 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:20.867212 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:21.003379 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:21.010931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2071da16-ea43-4d8b-a1b6-7833a08bc8fc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.161039 Jun 06 12:07:21.011492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 181/366] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:20 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:21.612019 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:21.612592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:21.618735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:21.619208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:21.619961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:21.620388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:21.644409 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a090d53-69d1-4fb9-b089-83adca2e2702 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/ips" status: 200 len: 149 microversion: 2.1 time: 0.037120 Jun 06 12:07:21.644983 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 186/367] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:07:21 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:22.028200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:22.028656 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:22.035286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:22.035731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:22.036489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:22.036915 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:22.168713 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:22.176108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5671158a-0e1b-4153-984e-019fa743d5fd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.152003 Jun 06 12:07:22.176667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 182/368] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:22 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:23.003794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d4d4ba7-81b9-4db9-a587-6493499b66cf"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:23.005047 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:23.011874 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:23.012418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:23.013282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:23.013777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:23.194573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:23.195294 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:23.202358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:23.202816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:23.203679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:23.204142 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:23.308975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-588c28a2-046f-4386-b848-29cdc766d680 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310107 Jun 06 12:07:23.309800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 187/369] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:07:22 2022] POST /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:23.350174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:23.360495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-121da00a-db2a-4eec-9501-68e0cb86b16c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.170517 Jun 06 12:07:23.361152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 183/370] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:23 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:24.382949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:24.383352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:24.395648 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:24.396192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:24.397049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:24.397493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:24.534801 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:24.542271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c5d17c32-d485-4e26-bd17-40a8dada7833 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.164931 Jun 06 12:07:24.542853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 188/371] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:24 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:25.560368 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:25.560979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:25.567570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:25.568026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:25.568948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:25.569333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:25.705538 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:25.712868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-821b84e1-97bb-468f-b750-bbbad8ee501b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.156996 Jun 06 12:07:25.713421 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 184/372] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:25 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:26.730750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:26.731546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:26.737932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:26.738378 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:26.739173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:26.739608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:26.875412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:26.883080 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-40740ee2-7ac0-4ddc-928e-22c91a95815a tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.156651 Jun 06 12:07:26.883740 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 189/373] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:26 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:27.900903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:27.901505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:27.903501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:27.909340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:27.909779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:27.910527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:27.910977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:28.065418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:28.072935 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-53950c3c-8628-4ee8-9147-1f93f3d69c09 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.175801 Jun 06 12:07:28.073492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 185/374] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:27 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:29.089749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:29.090352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:29.093091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:29.094119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:29.100015 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:29.100452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:29.101209 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:29.101637 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:29.231132 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:29.238478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0397f0e6-7e48-467a-9536-9ca8a9e5d02f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.152579 Jun 06 12:07:29.239100 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 190/375] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:29 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:30.255325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:30.255864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:30.261901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.262632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:30.263755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.264187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:30.415080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:30.424117 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e720b477-4af9-4af7-86ee-862fcd533a5b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.172634 Jun 06 12:07:30.424686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 186/376] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:30 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:30.644069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:30.644626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:30.651198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.651651 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:30.652449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.652886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:30.678616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3280c74-acb7-4269-a333-6755da098cbf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/ips" status: 200 len: 152 microversion: 2.20 time: 0.038403 Jun 06 12:07:30.679235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 191/377] 10.222.0.41 () {60 vars in 1288 bytes} [Mon Jun 6 12:07:30 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:07:30.875942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-428e6341-3604-4b0d-913b-95a451587b29 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: .version_select at 0x7fc16893e9d0>, body: {"keypair": {"name": "tempest-keypair-780275115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbebedvCMvOVw0BoFCht1IZebKFtKNTcD3RcL8yJ0pqixqxlA0DFB7gqHcnieWSJNHZfAgG89Zcky0D2YkLaNCHqqhj0CavqcCbVje/izXmaDcAvqY6Lg0csFjBgj7PCw=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:30.896439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-428e6341-3604-4b0d-913b-95a451587b29 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:07:30.901171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-428e6341-3604-4b0d-913b-95a451587b29 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:07:30.930586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-428e6341-3604-4b0d-913b-95a451587b29 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060364 Jun 06 12:07:30.932617 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 187/378] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:07:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:30.977676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:30.978177 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:30.985453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.986325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:30.987656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:30.988354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:31.032765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0fbcc00c-034e-46e6-a1b0-aeb32b6044f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/ips" status: 200 len: 146 microversion: 2.1 time: 0.060486 Jun 06 12:07:31.033358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 192/379] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:07:30 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:31.441521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:31.442253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:31.449148 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:31.449592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:31.451248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:31.451729 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:31.682139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:31.690576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6f783957-2068-41be-92c9-fc84560e9209 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.253145 Jun 06 12:07:31.691173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 188/380] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:31 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:32.677356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1518110599", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7652b7b-d4f4-4b94-9492-ad0df97f85c2"}], "security_groups": [{"name": "tempest-securitygroup--851316626"}], "key_name": "tempest-keypair-780275115", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:32.708047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:32.711724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:32.719787 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:32.720456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:32.721206 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:32.721873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:32.844201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] validate_networks() for [('f7652b7b-d4f4-4b94-9492-ad0df97f85c2', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:07:32.948429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:32.956650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03f156e8-dcf3-4b1e-a8fa-ab8fc763a779 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.252923 Jun 06 12:07:32.957307 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 189/381] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:32 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:32.961803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-88533f00-3116-4f2f-afb7-413c79b8cee2 req-0181802b-6e07-459c-a0cb-5f8275a86546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "name": "network-vif-plugged", "status": "completed", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:32.969918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-88533f00-3116-4f2f-afb7-413c79b8cee2 req-0181802b-6e07-459c-a0cb-5f8275a86546 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:32.970362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-88533f00-3116-4f2f-afb7-413c79b8cee2 req-0181802b-6e07-459c-a0cb-5f8275a86546 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:32.982167 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-88533f00-3116-4f2f-afb7-413c79b8cee2 req-0181802b-6e07-459c-a0cb-5f8275a86546 service nova] Creating event network-vif-plugged:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:07:32.990195 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-88533f00-3116-4f2f-afb7-413c79b8cee2 req-0181802b-6e07-459c-a0cb-5f8275a86546 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031654 Jun 06 12:07:32.990975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 190/382] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:33.262947 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:07:33.263377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:07:33.263857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:07:33.264268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:07:33.264681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:07:33.273711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.274164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:33.274999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.275440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:33.292658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:07:33.300351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:07:33.315121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:07:33.317564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:07:33.367421 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ebb0acf6-0558-4e06-a240-d7ace445076a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694423 Jun 06 12:07:33.368063 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 193/383] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:07:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:07:33.378655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1699b6ff-079f-445a-a683-02f13973306b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:33.379372 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1699b6ff-079f-445a-a683-02f13973306b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:33.436996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1699b6ff-079f-445a-a683-02f13973306b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:33.443984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1699b6ff-079f-445a-a683-02f13973306b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1241 microversion: 2.1 time: 0.069491 Jun 06 12:07:33.444778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 191/384] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:33 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:33.754312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:33.754875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:33.761493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.761933 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:33.763238 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.763670 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:33.785986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lazy-loading 'flavor' on Instance uuid 4a952182-3969-4289-8b82-48c462c44f9d {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:07:33.974400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:33.975610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:33.983870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.984322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:33.985095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:33.985565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.048028 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e871e779-9d2d-408a-bb99-1769ab1019af tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/action" status: 202 len: 0 microversion: 2.20 time: 0.297979 Jun 06 12:07:34.051882 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 194/385] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 12:07:33 2022] POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 12:07:34.057382 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:34.058284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:34.065361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.065817 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.066589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.067063 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.155120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:34.162505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-39f48ff9-a961-4a9a-83a0-ea9dcd82e7cd tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.192638 Jun 06 12:07:34.163093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 192/386] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:33 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:34.214652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:34.223813 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:34.225353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:34.226444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e217a181-4d71-490f-a5e0-b70f4cc15fd7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.173120 Jun 06 12:07:34.227026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 195/387] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:34 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:34.461053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:34.461652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:34.469062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.469500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.470253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.470684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.534791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:34.542165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f5156b13-f356-4b65-8ff2-5eeaa9e08d9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1237 microversion: 2.1 time: 0.085019 Jun 06 12:07:34.542718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 193/388] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:34 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:34.695309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fda2acf-dd2f-4084-9959-79d09cab503a"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:34.696389 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:34.702829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.703306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:34.704059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:34.704486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.179960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:35.180777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:35.187529 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.188012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.188782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.189246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.221607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9e7cb883-30b7-4caf-a88a-5115a8eb798b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529919 Jun 06 12:07:35.222566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 196/389] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:07:34 2022] POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:35.246393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:35.247790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:35.255158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.255524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.256324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.256753 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.370008 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:35.379308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cfb0ee1b-9468-4904-b340-59002ca6f5a9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1260 microversion: 2.1 time: 0.203007 Jun 06 12:07:35.379813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 194/390] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:35 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:35.419889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:35.423767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:35.429116 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:35.430607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:35.431767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a9b8e037-032a-4373-b131-d06b0043132d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.190079 Jun 06 12:07:35.432326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 197/391] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:35 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:35.560630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:35.561431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:35.576599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.577152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.577914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:35.578346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:35.645125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:35.653076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aeb9e282-7480-41d6-ae6a-daf40c19953d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1301 microversion: 2.1 time: 0.096773 Jun 06 12:07:35.653601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 195/392] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:35 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:36.395790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:36.396290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:36.404760 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.405213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.405986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.406611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.450778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:36.451435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:36.457450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.457895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.458659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.459120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.596932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.604779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb07f03f-9bb7-4b8a-bb95-fca4cb3fca89 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1444 microversion: 2.1 time: 0.212874 Jun 06 12:07:36.615975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 198/393] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:36 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1444 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:36.621879 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:36.622598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:36.626180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.629056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.629472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.630424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.630882 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.636443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.639282 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.640537 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-788f3984-65b4-417b-940e-6db19457627e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.194228 Jun 06 12:07:36.641271 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 196/394] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:36 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:36.670060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:36.670675 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:36.678806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.679284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.680065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:36.680526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:36.762866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.771635 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1191e7a9-07d4-4a26-b04c-e8ed0bd9cdf1 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1299 microversion: 2.1 time: 0.105606 Jun 06 12:07:36.779123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 197/395] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:36 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:36.793647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:36.801988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-16d63b3d-501a-4f24-b355-7c323688f735 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1444 microversion: 2.1 time: 0.184429 Jun 06 12:07:36.802484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 199/396] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:36 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1444 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:37.660215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:37.661524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:37.668190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:37.668984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:37.670041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:37.670718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:37.788926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:37.790109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:37.797129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:37.797668 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:37.798881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:37.799525 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:37.969707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:37.983664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:37.985901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:37.987178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-89090e44-f6a2-47c0-97b8-7ea8c7526ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.330961 Jun 06 12:07:37.987738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 198/397] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:37 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:37.992906 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ebd86d14-15d3-4cc6-b3f6-92c43066c459 req-7aa7afa3-2b0f-472e-b65f-321a37e0d0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350245e3-005d-45bf-92e0-788b04a2416c", "tag": "949f8eae-651f-4414-8e62-d9044117dae6"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:38.003175 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ebd86d14-15d3-4cc6-b3f6-92c43066c459 req-7aa7afa3-2b0f-472e-b65f-321a37e0d0dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:38.004581 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ebd86d14-15d3-4cc6-b3f6-92c43066c459 req-7aa7afa3-2b0f-472e-b65f-321a37e0d0dd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:38.011290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:38.024218 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ebd86d14-15d3-4cc6-b3f6-92c43066c459 req-7aa7afa3-2b0f-472e-b65f-321a37e0d0dd service nova] Creating event network-changed:949f8eae-651f-4414-8e62-d9044117dae6 for instance 350245e3-005d-45bf-92e0-788b04a2416c on hv-cinder-82549 Jun 06 12:07:38.030520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ebd86d14-15d3-4cc6-b3f6-92c43066c459 req-7aa7afa3-2b0f-472e-b65f-321a37e0d0dd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041248 Jun 06 12:07:38.031171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 199/398] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:38.081250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:38.088938 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e38a4cf-7b01-4891-952f-14b2e6d3c432 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.303929 Jun 06 12:07:38.089706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 200/399] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:37 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:38.895066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-39d98662-4e28-4d34-91ba-75b93258944c req-5e33e288-c3dc-4868-aa0a-84a41e5dcbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:38.903918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-39d98662-4e28-4d34-91ba-75b93258944c req-5e33e288-c3dc-4868-aa0a-84a41e5dcbed service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:38.904359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-39d98662-4e28-4d34-91ba-75b93258944c req-5e33e288-c3dc-4868-aa0a-84a41e5dcbed service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:38.915109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-39d98662-4e28-4d34-91ba-75b93258944c req-5e33e288-c3dc-4868-aa0a-84a41e5dcbed service nova] Creating event network-changed:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:07:38.921024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-39d98662-4e28-4d34-91ba-75b93258944c req-5e33e288-c3dc-4868-aa0a-84a41e5dcbed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 Jun 06 12:07:38.921608 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 200/400] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:39.005732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:39.006374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:39.013659 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:39.014200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:39.015010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:39.015451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:39.105869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:39.107006 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:39.113437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:39.114005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:39.115016 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:39.115649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:39.147509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:39.156431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:39.158109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:39.159439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fd35086f-a287-46e9-82b9-854ccd8877bf tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.157876 Jun 06 12:07:39.160133 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 201/401] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:39 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:39.249324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:39.256772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-249aae7b-f661-41cd-8582-17ff2f7f0031 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.154992 Jun 06 12:07:39.257268 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 201/402] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:39 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:40.178147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:40.178753 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:40.185469 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:40.185909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:40.186656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:40.187193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:40.273257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:40.273864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:40.280816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:40.281257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:40.282011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:40.282438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:40.315501 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:40.323533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:40.325623 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:40.326781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf5ca63a-6a4e-4e7a-8a68-496fa11bab6c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.152511 Jun 06 12:07:40.327366 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 202/403] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:40 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:40.408492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:40.415808 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9042c257-a18e-4148-9b73-5e6ae8d7671c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.146302 Jun 06 12:07:40.416393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 202/404] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:40 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:41.345333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:41.345977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:41.352454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:41.352898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:41.353653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:41.354084 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:41.433258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:41.434718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:41.440901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:41.441347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:41.442143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:41.442578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:41.499055 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:41.507220 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:41.508770 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:41.509928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1b43335d-f462-44df-a858-f6093e230c21 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.168802 Jun 06 12:07:41.510496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 203/405] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:41 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:41.581438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:41.588692 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-457d5409-1070-419a-8478-45dccdff9807 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.159263 Jun 06 12:07:41.589247 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 203/406] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:41 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:42.527555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:42.528174 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:42.534724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:42.535203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:42.535963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:42.536395 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:42.605608 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:42.606492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:42.613283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:42.613836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:42.614478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:42.614974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:42.702643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:42.713343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:42.720232 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:42.721796 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-985672ce-6af9-4739-bc4e-de82b80628e4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.198243 Jun 06 12:07:42.722909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 204/407] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:42 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:42.784497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:42.792236 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-960ab52a-7962-4790-9608-ed761697d4bc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.190596 Jun 06 12:07:42.793577 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 204/408] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:42 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:42.808067 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-782243608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2130326679", "security_groups": [{"name": "tempest-secgroup-smoke-692902684"}], "block_device_mapping_v2": [{"uuid": "2ea5bf0f-3b21-4010-905c-a3c337f8385e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:42.926007 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] validate_networks() for [('b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:07:43.282657 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:43.310665 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:43.499819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:07:43.500241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:07:43.500867 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:07:43.501295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:07:43.501718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:07:43.513854 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.514309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:43.515152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.515592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:43.533676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:07:43.537687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for user adb92379209e46e79de4df370183fa8a and project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:07:43.601833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:07:43.603965 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea5bf0f-3b21-4010-905c-a3c337f8385e',volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:07:43.741449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:43.742056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:43.744093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:43.745139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:43.747181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8f37a892-cd76-4e57-9074-2629f4fc3412 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.941779 Jun 06 12:07:43.753063 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 205/409] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:07:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:07:43.756452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.756905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:43.757682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.758115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:43.762074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-19241b92-bb24-4683-881c-dd628606fc5c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:43.763214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-19241b92-bb24-4683-881c-dd628606fc5c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:43.830770 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19241b92-bb24-4683-881c-dd628606fc5c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:43.841701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-19241b92-bb24-4683-881c-dd628606fc5c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1094 microversion: 2.1 time: 0.086388 Jun 06 12:07:43.847553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 206/410] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:43 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:43.856290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:43.856940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:43.863649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:43.865923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.866528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:43.867354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:43.867793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:44.019410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:44.029374 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:44.031323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:44.032503 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ced4fb19-41bc-4a01-9b94-0e9042c11ff2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.296193 Jun 06 12:07:44.033103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 205/411] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:43 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:44.055522 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:44.063327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-88dee926-81ef-4967-a509-c6b38d5298d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.219216 Jun 06 12:07:44.063902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 207/412] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:43 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:44.859779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:44.860545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:44.866554 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:44.867027 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:44.867791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:44.868220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:44.932407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:44.940364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-154be48a-29aa-4c01-9ec8-69e09ed80774 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1192 microversion: 2.1 time: 0.085300 Jun 06 12:07:44.941031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 206/413] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:44 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:44.949967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b991ff89-43ac-45f2-a48b-40cb618894d1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:44.956691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b991ff89-43ac-45f2-a48b-40cb618894d1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:44.957133 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b991ff89-43ac-45f2-a48b-40cb618894d1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.017875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b991ff89-43ac-45f2-a48b-40cb618894d1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Going to try to stop instance {{(pid=117630) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 12:07:45.051578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:45.052184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:45.058321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.058783 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.059587 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.060018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.061436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b991ff89-43ac-45f2-a48b-40cb618894d1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action" status: 202 len: 0 microversion: 2.1 time: 0.115927 Jun 06 12:07:45.062063 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 208/414] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:07:44 2022] POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:07:45.070197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:45.070911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:45.077985 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.078377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.079189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.079628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.281070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:45.289560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:45.291363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:45.292815 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a15bdb45-66a8-45f9-a16d-df9bebc3a1f6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.244939 Jun 06 12:07:45.293559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 207/415] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:45 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:45.296117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:45.298135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:45.298811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:45.304656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-74df785b-6219-424f-afab-41820362785e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.238324 Jun 06 12:07:45.304937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.305226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 209/416] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:45 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:45.305458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.306222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.306657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.447455 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:45.457237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-23f484f4-a4a7-436d-8b76-67e3d99c5e3b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.162634 Jun 06 12:07:45.457809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 208/417] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:45 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:45.957673 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:45.958285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:45.966230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.966677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:45.967524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:45.968204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.031256 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.038730 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d8d9160a-69a7-4f1c-b633-7595e6bcdd94 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1210 microversion: 2.1 time: 0.085066 Jun 06 12:07:46.039342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 210/418] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:45 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:46.312076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:46.312704 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:46.319553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.320153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.321026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.321643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.322170 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:46.322943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:46.329755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.330388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.331183 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.331614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.538398 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.540423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.563686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-51083b50-dd12-457e-b7a9-8da9833d5a6d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.244942 Jun 06 12:07:46.565912 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 211/419] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:46 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:07:46.570285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.572114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:46.572251 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.572722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:46.574303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fecbd8d2-6f75-4e90-877f-51525fca4d41 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.266283 Jun 06 12:07:46.575426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 209/420] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:46 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:46.592952 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.593461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.594232 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.594855 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.773163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:46.781237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-30222397-bd96-495f-9775-0c39df61a7ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.212850 Jun 06 12:07:46.782880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 212/421] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:46 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:46.842223 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-59ffac8f-d8a7-4836-bc3a-d65a720c359e req-3fbf4193-7deb-4fd5-8ccd-f574dd22cf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350245e3-005d-45bf-92e0-788b04a2416c", "name": "network-vif-plugged", "status": "completed", "tag": "949f8eae-651f-4414-8e62-d9044117dae6"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:46.853401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-59ffac8f-d8a7-4836-bc3a-d65a720c359e req-3fbf4193-7deb-4fd5-8ccd-f574dd22cf9c service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:46.853643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-59ffac8f-d8a7-4836-bc3a-d65a720c359e req-3fbf4193-7deb-4fd5-8ccd-f574dd22cf9c service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:46.867869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-59ffac8f-d8a7-4836-bc3a-d65a720c359e req-3fbf4193-7deb-4fd5-8ccd-f574dd22cf9c service nova] Creating event network-vif-plugged:949f8eae-651f-4414-8e62-d9044117dae6 for instance 350245e3-005d-45bf-92e0-788b04a2416c on hv-cinder-82549 Jun 06 12:07:46.874045 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-59ffac8f-d8a7-4836-bc3a-d65a720c359e req-3fbf4193-7deb-4fd5-8ccd-f574dd22cf9c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038335 Jun 06 12:07:46.874659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 210/422] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:07:47.055061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:47.056276 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:47.067257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.068056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.069030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.069823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.231995 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.240526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aed0acd5-9097-4d68-abdd-5884eaf99867 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.189231 Jun 06 12:07:47.241419 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 213/423] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:47 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:47.584041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:47.584742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:47.591811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.592260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.593288 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.593723 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.595868 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:47.596799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:47.606817 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.607607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.608540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.609135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.799887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.813865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d048089d-f4ab-422a-81a0-6cd8277517c5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.234230 Jun 06 12:07:47.823564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 211/424] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:47 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:47.823564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:47.823564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:47.830003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.830551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.831799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.832250 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.835916 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.846615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.857611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.859194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4346f85d-724d-4c5a-b394-65d4d9de9e6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.268808 Jun 06 12:07:47.870992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 214/425] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:47 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:47.870992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7f9820b1-fb5f-43f8-863f-927f9bb88acc req-a65fea6d-25b0-4c2f-8339-67df51f5daf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105b21a4-46f9-4578-a9d6-7e368603efea", "tag": "5b0256cb-e62e-4d57-9fdd-534c0db702ae"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:47.875797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7f9820b1-fb5f-43f8-863f-927f9bb88acc req-a65fea6d-25b0-4c2f-8339-67df51f5daf7 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:47.876565 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7f9820b1-fb5f-43f8-863f-927f9bb88acc req-a65fea6d-25b0-4c2f-8339-67df51f5daf7 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:47.895223 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:47.913061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7f9820b1-fb5f-43f8-863f-927f9bb88acc req-a65fea6d-25b0-4c2f-8339-67df51f5daf7 service nova] Creating event network-changed:5b0256cb-e62e-4d57-9fdd-534c0db702ae for instance 105b21a4-46f9-4578-a9d6-7e368603efea on hv-cinder-82549 Jun 06 12:07:47.920749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7f9820b1-fb5f-43f8-863f-927f9bb88acc req-a65fea6d-25b0-4c2f-8339-67df51f5daf7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058465 Jun 06 12:07:47.921689 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 215/426] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:47.981707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:47.989290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-933107df-043e-4306-a7f5-84bad3884414 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.173142 Jun 06 12:07:47.989857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 212/427] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:47 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:48.258592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:48.259239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:48.266403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.266861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:48.267643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.268077 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:48.398039 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:48.405472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a7160ed8-18f0-4d59-85ad-6e03d7d01fb2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.151659 Jun 06 12:07:48.406041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 216/428] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:48 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:48.831168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:48.831847 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:48.837772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.838217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:48.839014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.839450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:48.878455 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:48.879188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:48.886118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.886118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:48.887034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:48.887318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:49.027575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.035543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-53ccf714-685b-4641-8548-3b38101ee9b6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.208285 Jun 06 12:07:49.036116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 213/429] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:48 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:49.040557 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:49.041196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:49.047698 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:49.048153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:49.048912 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:49.049347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:49.054695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.063401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.064904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.066048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3a2a551e-6b8d-4643-bb25-93c1d340064d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.191373 Jun 06 12:07:49.066609 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 217/430] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:48 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:49.186338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.194137 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8e74c64d-b9b6-452a-912a-824068b4933d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1366 microversion: 2.1 time: 0.157049 Jun 06 12:07:49.194748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 214/431] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:49 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:49.421982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:49.422581 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:49.429016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:49.429454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:49.430252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:49.430715 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:49.559494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:49.566717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f853f72b-2dab-4698-ba62-f16ef08ec4f9 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.148595 Jun 06 12:07:49.567324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 218/432] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:49 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:50.053379 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:50.054390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:50.060549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.060997 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.061769 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.062206 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.084976 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:50.085589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:50.091867 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.092318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.093342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.093785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.264166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.270864 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.272024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5f6a6406-e221-4718-a687-3ae59d0398f6 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.222465 Jun 06 12:07:50.272574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 215/433] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:50 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:50.276941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:50.277533 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:50.279067 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.280582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.281714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-21bf93bb-db45-466c-a1f0-7c2133408e0b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.200641 Jun 06 12:07:50.282304 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 219/434] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:50 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:50.283199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.283650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.284429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.284858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.409634 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.417512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-00453652-8f83-43b5-9ca5-eeffe83f9e36 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1556 microversion: 2.1 time: 0.143491 Jun 06 12:07:50.418085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 216/435] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:50 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1556 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:50.434357 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:50.434854 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:50.441272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.441748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.442499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.442973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.523588 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dca50794-09df-46e8-a7b3-c93d72bf655f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093824 Jun 06 12:07:50.524178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 220/436] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:07:50 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:50.583330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:50.583973 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:50.590540 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.591032 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.591794 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:50.592227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:50.842904 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:50.846531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:50.851261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f713b7eb-9198-4c87-905e-7539b22851e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.271437 Jun 06 12:07:50.851963 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 217/437] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:50 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:51.288846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:51.289802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:51.300701 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:51.301892 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:51.308900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.309343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.310108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.310544 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.312018 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.312464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.313237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.313676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.595222 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:51.603197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4d933c79-6bd7-4197-a1e5-ef7a23006e07 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.318147 Jun 06 12:07:51.603767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 221/438] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:51 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:51.611541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:51.619346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:51.621564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:51.622719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4da9acdb-ae44-4680-9f27-89139f84281a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.326049 Jun 06 12:07:51.623312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 218/439] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:51 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:51.870613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:51.871304 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:51.879636 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.879764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.880718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.881154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.913591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-e54e87e1-e8ad-4e87-a1ef-c5a564d55ccb req-044ce655-f6d8-4b2e-8cbf-aecbe416d5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "350245e3-005d-45bf-92e0-788b04a2416c", "tag": "949f8eae-651f-4414-8e62-d9044117dae6"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:51.923830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e54e87e1-e8ad-4e87-a1ef-c5a564d55ccb req-044ce655-f6d8-4b2e-8cbf-aecbe416d5f1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:51.924276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e54e87e1-e8ad-4e87-a1ef-c5a564d55ccb req-044ce655-f6d8-4b2e-8cbf-aecbe416d5f1 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:51.936802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-e54e87e1-e8ad-4e87-a1ef-c5a564d55ccb req-044ce655-f6d8-4b2e-8cbf-aecbe416d5f1 service nova] Creating event network-changed:949f8eae-651f-4414-8e62-d9044117dae6 for instance 350245e3-005d-45bf-92e0-788b04a2416c on hv-cinder-82549 Jun 06 12:07:51.942633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-e54e87e1-e8ad-4e87-a1ef-c5a564d55ccb req-044ce655-f6d8-4b2e-8cbf-aecbe416d5f1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Jun 06 12:07:51.943461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 219/440] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:07:52.026681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:52.034695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f04aca58-feb4-4688-b99f-a784946d8b32 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.169744 Jun 06 12:07:52.035572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 222/441] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:51 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:52.621683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:52.622377 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:52.628620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:52.629060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:52.629822 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:52.630258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:52.641912 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:52.642909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:52.651191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:52.653098 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:52.654017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:52.654545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:52.845272 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:52.848781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:52.857226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3d64989d-ff3f-45ec-ac3d-d85726f11efd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.239761 Jun 06 12:07:52.857704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:52.859939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 220/442] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:52 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:52.860701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:52.862239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-918aa52c-c869-47c9-a1dc-4240d79b746d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.224508 Jun 06 12:07:52.863294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 223/443] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:52 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:53.052944 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:53.053558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:53.060274 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.060723 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:53.061475 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.061906 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:53.195203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:53.203464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b5012c62-1e9c-41ec-84da-63659727e54d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.154449 Jun 06 12:07:53.204023 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 221/444] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:53 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:53.874582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:53.875152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:53.877118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:53.878237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:07:53.881684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:53.882293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:53.883952 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.884397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:53.885156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.885614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:53.888641 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.889089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:53.889851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:53.890285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:54.089637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:54.092905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:54.098030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:54.099579 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:54.100781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e49544e-f653-4069-a609-1b74697fb24b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.223349 Jun 06 12:07:54.100917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-97c9514a-e37b-4f5d-b868-699fa502c765 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.230198 Jun 06 12:07:54.101604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 222/446] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:53 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:54.101734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 224/446] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:53 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:54.221207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:54.221950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:54.227942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:54.228380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:54.229176 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:54.229901 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:54.358767 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:54.366212 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cd4e7fb1-7b09-4db5-93c9-9c548b8792c3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.149237 Jun 06 12:07:54.366768 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 223/447] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:54 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:55.119103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:55.120521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:55.120644 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:55.121289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:55.127380 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.127535 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.127833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.127950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.128601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.128708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.129037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.129293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.328073 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:55.335043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:55.336481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2cdcb220-d707-4252-98b1-6dbbf5775019 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.221230 Jun 06 12:07:55.337067 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 225/448] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:55 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:55.343457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:55.344978 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:55.346121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-162cb053-f681-4032-b7ff-e90ddc72851b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.230101 Jun 06 12:07:55.346674 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 224/449] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:55 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:07:55.383095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:55.383702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:55.390264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.390710 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.391502 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:55.391942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:55.523904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:55.531385 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7c22e557-a600-41b2-aaa7-ec2a575413af tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.152134 Jun 06 12:07:55.531954 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 226/450] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:55 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:56.353972 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:56.354954 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:56.360971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.361420 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.362184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.362621 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.364513 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:56.365123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:56.372281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.372736 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.373481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.373909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.560391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:56.567498 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:56.568244 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-add1ee18-dce0-40db-97f7-561a6cc642a2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.218107 Jun 06 12:07:56.568810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 225/451] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:56 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:56.573844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:56.574452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:56.576993 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:56.578493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:56.579678 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4287488f-770f-4dae-997c-07a6db70df42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.218954 Jun 06 12:07:56.580226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 227/452] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:56 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:56.580369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.580774 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.581600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.582033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.716569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:56.724356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-931774ce-5293-4bda-a9ea-8ee0c43a2dd8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.154609 Jun 06 12:07:56.724922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 226/453] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:56 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:56.845301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-c6da85ca-19be-40ce-a8ad-bf11c275670b req-342b0a73-4f4e-4ca6-beb3-4afa5357403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "name": "network-vif-plugged", "status": "completed", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:07:56.854501 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c6da85ca-19be-40ce-a8ad-bf11c275670b req-342b0a73-4f4e-4ca6-beb3-4afa5357403a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:56.855236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-c6da85ca-19be-40ce-a8ad-bf11c275670b req-342b0a73-4f4e-4ca6-beb3-4afa5357403a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:56.868863 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-c6da85ca-19be-40ce-a8ad-bf11c275670b req-342b0a73-4f4e-4ca6-beb3-4afa5357403a service nova] Creating event network-vif-plugged:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:07:56.874651 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-c6da85ca-19be-40ce-a8ad-bf11c275670b req-342b0a73-4f4e-4ca6-beb3-4afa5357403a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033955 Jun 06 12:07:56.875443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 228/454] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:07:57.586242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:57.586869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:57.593411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.593867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.594627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.595103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.597982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:57.600119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:57.605390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.605829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.606580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.607040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.789168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:57.796575 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:57.798132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ccd28530-acbf-425a-9d3b-36ed3c178334 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.215653 Jun 06 12:07:57.798788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 227/455] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:57 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:57.803275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:57.804107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:57.804778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:57.806288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:57.808413 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e33dadf4-3acc-410d-83a5-f4165fdf2c4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.214451 Jun 06 12:07:57.809196 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 229/456] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:57 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:57.811028 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.811483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.812257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:57.812690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:57.942516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:57.950214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd8ee8d2-d4d0-4965-b407-1bf55797d369 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.150396 Jun 06 12:07:57.950800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 228/457] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:57 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:58.816687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:58.817302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:58.824791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:58.825189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:58.826104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:58.826401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:58.827536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:58.828157 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:58.836427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:58.836882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:58.837664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:58.838162 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:59.042407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:59.046777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:59.050710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:59.052310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:59.053473 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7c982213-f9a6-436c-8afb-3a527ddfe68f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1743 microversion: 2.20 time: 0.230846 Jun 06 12:07:59.054031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 229/458] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:07:58 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:07:59.054756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0d345997-b82b-4eab-89d0-461ce5e98682 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.241937 Jun 06 12:07:59.055343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 230/459] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:58 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:07:59.061407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:07:59.062118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:07:59.068237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:59.068676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:59.069428 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:07:59.069853 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:07:59.201065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:07:59.208541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4cc57434-1274-4e81-987e-9f0a7b2bdad8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.151793 Jun 06 12:07:59.209109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 230/460] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:07:59 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:00.072522 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:00.073112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:00.073477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:00.073680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:00.080193 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.080781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.080931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.081298 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.081755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.082198 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.082301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.082680 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.298330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:00.302346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:00.306477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:00.308807 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:00.309982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d5c46b77-ab6a-4f42-8eb5-bd7f76b9a235 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.241537 Jun 06 12:08:00.310545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 231/461] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:00 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:00.318349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0ccd27d5-2d47-4afb-bdb2-84fde477e650 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.243791 Jun 06 12:08:00.318349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 231/462] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:00 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:00.319027 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:00.319638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:00.325980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.326446 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.327214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:00.327650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:00.472859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:00.481013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e5ddeac7-235b-4718-8029-7c6c170f9cda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.166649 Jun 06 12:08:00.481687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 232/463] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:00 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:01.330378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:01.331215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:01.332055 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:01.332568 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:01.341210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.342515 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.343604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.344289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.357914 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.359075 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.361211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.361735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.672459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:01.682731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bc47bde0-7989-4efc-ac2f-4c471ed7cb7d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.355243 Jun 06 12:08:01.682731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 233/464] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:01 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:01.697894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-8e2f53f8-3d26-4306-87c7-2fada50352df req-0164f88e-5176-430b-a6c0-08552772f850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105b21a4-46f9-4578-a9d6-7e368603efea", "name": "network-vif-plugged", "status": "completed", "tag": "5b0256cb-e62e-4d57-9fdd-534c0db702ae"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:01.707900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-8e2f53f8-3d26-4306-87c7-2fada50352df req-0164f88e-5176-430b-a6c0-08552772f850 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.708489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-8e2f53f8-3d26-4306-87c7-2fada50352df req-0164f88e-5176-430b-a6c0-08552772f850 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.724256 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-8e2f53f8-3d26-4306-87c7-2fada50352df req-0164f88e-5176-430b-a6c0-08552772f850 service nova] Creating event network-vif-plugged:5b0256cb-e62e-4d57-9fdd-534c0db702ae for instance 105b21a4-46f9-4578-a9d6-7e368603efea on hv-cinder-82549 Jun 06 12:08:01.728029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-8e2f53f8-3d26-4306-87c7-2fada50352df req-0164f88e-5176-430b-a6c0-08552772f850 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044417 Jun 06 12:08:01.728785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 234/465] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:08:01.735021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:01.735713 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:01.742534 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.743027 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.743790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:01.744856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:01.756090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:01.773771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:01.776406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:01.777826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c4baaa92-f9b6-4c3a-8bfd-a623f9547c3c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.452024 Jun 06 12:08:01.790696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 232/466] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:01 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:01.908032 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:01.912089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:01.921858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f8ee36ed-f6e8-411d-a8c2-a3dc0e9734b5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.190914 Jun 06 12:08:01.922628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 235/467] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:01 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:02.699664 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:02.700285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:02.708636 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.709089 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.709992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.710436 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.735953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:02.801237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:02.802775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:02.811086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.811719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.813178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.813350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.871258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:02.880114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5ee82d66-d7de-452a-9651-9926b187b932 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.185326 Jun 06 12:08:02.880975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 233/468] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:02 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:02.938618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:02.939282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:02.945697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.946440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.949029 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:02.949709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:02.981629 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:02.991173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:02.992791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:02.994105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cfe1c74c-e495-4eb2-9052-f25444289205 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.197927 Jun 06 12:08:02.998872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 236/469] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:02 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:03.098208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:03.107712 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d64f6eb1-972b-4156-ad03-45b6ff7ef93c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.172989 Jun 06 12:08:03.108675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 234/470] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:02 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:03.897738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:03.898320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:03.906668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:03.907397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:03.908235 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:03.908764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:04.014082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:04.014762 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:04.032434 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:04.033213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:04.034585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:04.035299 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:04.099418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:04.112837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-143f0e83-c3cd-4eb6-a32d-3252c8021da5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.218942 Jun 06 12:08:04.122870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 237/471] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:03 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:04.125349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:04.126265 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:04.137095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:04.137532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:04.138300 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:04.138730 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:04.277198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:04.292386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:04.295875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:04.297356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e88c467e-ccbf-4807-b037-201d39779203 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.287834 Jun 06 12:08:04.315157 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 235/472] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:04 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:04.332069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:04.340504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-deacf65c-aa66-4c05-928f-0fa64858ca37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1265 microversion: 2.1 time: 0.218940 Jun 06 12:08:04.341073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 238/473] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:04 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:05.131738 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:05.132967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:05.141033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.142339 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.143150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.143589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.303221 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.313617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dc703c2b-0b88-4e06-bd7b-e6d3f1fb4ef0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1724 microversion: 2.1 time: 0.185706 Jun 06 12:08:05.314376 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 236/474] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:05 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:05.321524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:05.322243 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:05.328762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.329299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.330139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.330646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.359149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:05.359990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:05.380615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.381062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.382105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.382542 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.530872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.546289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.548938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.549884 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1004d034-64dd-4393-9897-c6cba292a0ee tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.232014 Jun 06 12:08:05.563679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 239/475] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:05 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:05.580940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.590271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0f7aeedb-38b3-4f00-a547-dc74d90e607b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1451 microversion: 2.1 time: 0.235830 Jun 06 12:08:05.590865 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 237/476] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:05 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1451 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:05.608908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:05.609555 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:05.616459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.616911 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.617673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:05.618103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:05.769897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:05.779573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9544fad8-c840-40c1-be79-a2a94247c960 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1451 microversion: 2.1 time: 0.174526 Jun 06 12:08:05.780371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 240/477] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:05 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:06.331810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:06.333439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:06.355113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.355622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.356490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.356998 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.575058 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:06.576430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:06.583287 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.583979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.584920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.585510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.725294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:06.745185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5ca459dc-43c3-433c-8cfb-9eaa6ce5cd51 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1701 microversion: 2.1 time: 0.417814 Jun 06 12:08:06.756725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 238/478] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:06 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1701 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:06.763002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e63063ee-cd71-420d-9858-d1e0fd78ea23 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:06.771272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e63063ee-cd71-420d-9858-d1e0fd78ea23 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.771931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e63063ee-cd71-420d-9858-d1e0fd78ea23 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.796502 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e63063ee-cd71-420d-9858-d1e0fd78ea23 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Going to try to start instance {{(pid=117630) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 12:08:06.855493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e63063ee-cd71-420d-9858-d1e0fd78ea23 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action" status: 202 len: 0 microversion: 2.1 time: 0.092759 Jun 06 12:08:06.856486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 239/479] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:08:06 2022] POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:08:06.866620 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:06.867101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:06.878121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.878619 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.879796 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:06.880193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:06.918251 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:06.933292 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:06.936061 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:06.937441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5b2716ac-e632-434c-bda6-e1209aa21bd9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.370337 Jun 06 12:08:06.938001 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 241/480] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:06 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:07.200162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:07.210202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1b9e412e-245e-406c-ba69-41c19d072c69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1710 microversion: 2.1 time: 0.349108 Jun 06 12:08:07.221758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 240/481] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:06 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1710 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:07.959202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:07.960041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:07.984519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:07.985659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:07.987364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:07.988385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:08.233051 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:08.234176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:08.247573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:08.248410 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:08.249614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:08.250395 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:08.554668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:08.577338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:08.578882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:08.598040 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8f9a5735-8577-428e-848e-c2ce44be62e7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.642566 Jun 06 12:08:08.599748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 242/482] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:07 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:08.617336 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-fa95fb30-ccc9-47f4-813c-4d5fdb320763 req-d6b25d14-a391-4479-bfe8-867984750883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105b21a4-46f9-4578-a9d6-7e368603efea", "tag": "5b0256cb-e62e-4d57-9fdd-534c0db702ae"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:08.632889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fa95fb30-ccc9-47f4-813c-4d5fdb320763 req-d6b25d14-a391-4479-bfe8-867984750883 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:08.633968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-fa95fb30-ccc9-47f4-813c-4d5fdb320763 req-d6b25d14-a391-4479-bfe8-867984750883 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:08.645432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:08.655961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-06081b01-aeed-4a66-9622-533c22124606 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1710 microversion: 2.1 time: 0.429170 Jun 06 12:08:08.657336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 241/483] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:08 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1710 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:08.660859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-fa95fb30-ccc9-47f4-813c-4d5fdb320763 req-d6b25d14-a391-4479-bfe8-867984750883 service nova] Creating event network-changed:5b0256cb-e62e-4d57-9fdd-534c0db702ae for instance 105b21a4-46f9-4578-a9d6-7e368603efea on hv-cinder-82549 Jun 06 12:08:08.666364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-fa95fb30-ccc9-47f4-813c-4d5fdb320763 req-d6b25d14-a391-4479-bfe8-867984750883 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060407 Jun 06 12:08:08.667259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 243/484] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:08:09.617314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:09.619207 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:09.629090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:09.634677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:09.636509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:09.637109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:09.674154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:09.675528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:09.683140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:09.684821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:09.685775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:09.686370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:09.903672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:09.913999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:09.921529 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:09.922794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d2d49275-6c95-4333-b492-71a03b163877 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.309566 Jun 06 12:08:09.923423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 242/485] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:09 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:09.953494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:09.967417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e227ffee-294e-44f1-b124-749f5168b1db tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1714 microversion: 2.1 time: 0.297187 Jun 06 12:08:09.968284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 244/486] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:09 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1714 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:08:10.940872 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:10.941405 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:10.949042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:10.949484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:10.950252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:10.950685 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:11.083203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:11.092074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:11.093611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:11.094756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7e61b4b1-819d-460f-9f90-3405056c7617 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1738 microversion: 2.20 time: 0.157951 Jun 06 12:08:11.095346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 243/487] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:10 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:12.115988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:12.116535 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:12.123719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:12.124336 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:12.125309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:12.125811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:12.261037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:12.268736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:12.270231 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:12.271406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-df2b31fb-d768-451e-91d9-984b7daef6f0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1720 microversion: 2.20 time: 0.159512 Jun 06 12:08:12.271960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 245/488] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:12 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:13.289596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:13.291204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:13.297961 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:13.298403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:13.299195 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:13.299626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:13.430775 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:13.439356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:13.440851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:13.441987 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c804f00f-d95e-4b7d-b25b-79a5879df529 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1720 microversion: 2.20 time: 0.156449 Jun 06 12:08:13.442535 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 244/489] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:13 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:14.463077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:14.463740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:14.465727 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=82 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:14.471857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:14.472294 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:14.473113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:14.473521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:14.610206 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:14.618721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:14.620275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:14.621411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da94707f-e8c9-4874-8da3-2b02f32f9c59 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1663 microversion: 2.20 time: 0.164311 Jun 06 12:08:14.621967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 246/490] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:14 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:14.639320 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8da16c9-28a8-48be-a0a6-5bfcd8e6d7e5"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:14.640465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:14.643047 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=75 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:14.648699 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:14.649149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:14.650544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:14.651061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:14.936173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9e33c50e-942b-4afa-becd-45359eb66cf8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300565 Jun 06 12:08:14.937279 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 245/491] 10.222.0.41 () {62 vars in 1363 bytes} [Mon Jun 6 12:08:14 2022] POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:08:15.052999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:15.053433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:15.059491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:15.059931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:15.060679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:15.061108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:15.151843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aa71f8d7-2b49-4b07-8070-f073e9df7f43 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/action" status: 202 len: 0 microversion: 2.20 time: 0.102770 Jun 06 12:08:15.152467 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 247/492] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 12:08:15 2022] POST /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:08:15.160438 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:15.161047 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:15.167769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:15.168214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:15.168978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:15.169414 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:15.188500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:15.302986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:15.312492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:15.314009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:15.315572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-44b59545-ed51-474e-906d-3559c88015ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1749 microversion: 2.20 time: 0.158569 Jun 06 12:08:15.315828 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 246/493] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:15 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1749 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:15.445706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-95884276-ebc8-49b2-a1db-23f2e10ce0e5 req-f8272383-1814-4cd6-8aeb-aee76317243a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "name": "network-vif-unplugged", "status": "completed", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:15.457086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-95884276-ebc8-49b2-a1db-23f2e10ce0e5 req-f8272383-1814-4cd6-8aeb-aee76317243a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:15.457586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-95884276-ebc8-49b2-a1db-23f2e10ce0e5 req-f8272383-1814-4cd6-8aeb-aee76317243a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:15.470818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.compute.server_external_events [req-95884276-ebc8-49b2-a1db-23f2e10ce0e5 req-f8272383-1814-4cd6-8aeb-aee76317243a service nova] Unable to find a host for instance 4a952182-3969-4289-8b82-48c462c44f9d. Dropping event network-vif-unplugged {{(pid=117629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 12:08:15.471696 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-95884276-ebc8-49b2-a1db-23f2e10ce0e5 req-f8272383-1814-4cd6-8aeb-aee76317243a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029856 Jun 06 12:08:15.472484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 248/494] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 12:08:16.333569 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:16.334514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:16.342052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:16.342498 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:16.343283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:16.343719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:16.475369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:16.484692 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:16.486183 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:16.487349 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c72aaa79-9e68-45b1-a522-25c477c399dc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1751 microversion: 2.20 time: 0.157859 Jun 06 12:08:16.487912 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 247/495] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:16 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:17.507607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:17.508215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:17.514828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:17.515299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:17.516049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:17.516480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:17.646197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:17.655230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:17.656714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:17.657848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0eca79b2-778f-4185-a314-b513f9eae0e1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.154199 Jun 06 12:08:17.658433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 249/496] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:17 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:18.678566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:18.680079 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:18.690024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:18.691059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:18.692165 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:18.692831 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:18.894258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:18.906690 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:18.908441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:18.909571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fab195b9-5345-4cb2-98e7-02453f0cbd1f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.236660 Jun 06 12:08:18.910336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 248/497] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:18 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:19.928699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:19.929343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:19.936238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:19.936689 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:19.937448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:19.937885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:20.084711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:20.093460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:20.095026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:20.096175 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-df289a66-bf97-42bc-bcd7-f0a46eb2ebaa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.171556 Jun 06 12:08:20.096744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 250/498] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:19 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:21.116323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:21.117001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:21.124546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:21.124988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:21.125756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:21.126224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:21.260088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:21.269295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:21.270751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:21.271933 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c6c967c2-9a0e-4052-a0fd-a23008645219 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.160876 Jun 06 12:08:21.272492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 249/499] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:21 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:22.291338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:22.292041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:22.297929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:22.298381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:22.299187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:22.299628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:22.435894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:22.444467 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:22.446028 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:22.447215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-24d6e1db-aa87-4cc9-bbf3-a2dc469eb395 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.160101 Jun 06 12:08:22.447803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 251/500] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:22 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:23.466755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:23.467494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:23.474053 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:23.474495 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:23.475270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:23.475731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:23.621392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:23.629988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:23.631509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:23.632647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-16ce3a45-02b3-4960-9743-049472775ecd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.171081 Jun 06 12:08:23.633207 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 250/501] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:23 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:24.652792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:24.653568 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:24.659491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:24.659932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:24.660694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:24.661121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:24.794933 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:24.798283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:24.803890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:24.805362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:24.806490 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-85ebbc81-2177-4435-8528-773d60a084e6 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.158679 Jun 06 12:08:24.807180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 252/502] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:24 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:25.825788 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:25.826343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:25.834445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:25.834926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:25.835757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:25.836146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:25.967679 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:25.976872 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:25.989109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:25.990346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8ef49eaf-51d1-4b76-9a12-98f7496627c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.168840 Jun 06 12:08:25.992327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 251/503] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:25 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:27.009528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:27.010910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:27.019071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:27.019251 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:27.020028 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:27.020466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:27.021125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "272e0b32-e224-4eb0-860f-f7e3e6d5ffbd"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:27.022346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:27.030387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:27.031512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:27.032497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:27.032614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:27.201205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:27.210024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:27.211543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:27.212694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ff6fc24f-ee56-41cf-b2b7-6444a9f46f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.207184 Jun 06 12:08:27.224109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 253/504] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:27 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:28.231139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:28.231832 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:28.238328 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:28.238775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:28.239574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:28.240014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:28.382081 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:28.391841 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:28.393346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:28.394504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-53079a01-7cc1-4ea4-abb6-359991bdcfd1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.167330 Jun 06 12:08:28.395276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 254/505] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:28 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:29.412846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:29.414214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:29.420516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:29.420973 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:29.421747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:29.422184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:29.571264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:29.583043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:29.584610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:29.585975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-67017419-608d-480d-9934-0d1c888f0f5e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.177028 Jun 06 12:08:29.599366 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 255/506] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:29 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:30.606034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:30.606763 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:30.613054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:30.613500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:30.614257 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:30.614693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:30.749370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:30.757778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:30.759296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:30.761134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cbf95057-951f-4ee1-9f6e-bf28174607b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.159825 Jun 06 12:08:30.761693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 256/507] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:30 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:31.780054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:31.780681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:31.789477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:31.790255 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:31.792245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:31.792945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:31.928425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:31.937242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:31.938721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:31.939881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0ecf849a-e92c-48a4-a266-4b1c8c29c21f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.163961 Jun 06 12:08:31.940426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 257/508] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:31 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:32.958253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:32.958946 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:32.965619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:32.966393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:32.967189 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:32.967627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:33.121125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:33.130109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:33.131626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:33.132882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4ae4a5c5-35a2-45a4-85e4-85484aa569c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.178600 Jun 06 12:08:33.133518 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 258/509] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:32 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:34.153861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:34.155152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:34.161665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:34.162110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:34.162887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:34.163325 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:34.292718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:34.301074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:34.302576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:34.303751 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-eee0206d-682c-41a1-9592-7c05f8021206 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.154479 Jun 06 12:08:34.304308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 259/510] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:34 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:35.323120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:35.323766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:35.329759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:35.330205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:35.331003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:35.331437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:35.460118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:35.469722 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:35.471275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:35.472387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ca49d358-bdde-4fd3-aeff-380c0ed39a2c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.153708 Jun 06 12:08:35.472933 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 260/511] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:35 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:35.593945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-de0ef5ac-3532-4b25-a1e2-b18fa8cda1fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.576884 Jun 06 12:08:35.594677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 252/512] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:08:27 2022] POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments => generated 194 bytes in 8579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:08:36.490238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:36.490865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:36.497151 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:36.497596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:36.498387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:36.498818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:36.628361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:36.637199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:36.638704 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:36.639888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fad09623-6de2-472d-a82a-585fe8c4234b tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.153515 Jun 06 12:08:36.640448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 261/513] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:36 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:37.659616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:37.660299 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:37.662743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=15 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:37.669743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:37.670195 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:37.671040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:37.671484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:37.804156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:37.813022 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:37.814528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:37.815704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-89f4e6c8-f9d6-4103-a902-c34df6a5bc05 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.160367 Jun 06 12:08:37.816263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 253/514] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:37 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:38.833383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:38.834152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:38.840430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:38.841136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:38.841899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:38.842333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:38.969806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:38.979209 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:38.980733 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:38.981882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-52f5f905-91a9-4aa8-9242-4e10016bb4c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.152750 Jun 06 12:08:38.982443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 262/515] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:38 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:40.000158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:40.000795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:40.007393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:40.007837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:40.008636 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:40.009624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:40.139516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:40.147868 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:40.149367 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:40.150851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-93193e7b-acf4-4b49-b01c-d21038a74ffe tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.154568 Jun 06 12:08:40.151439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 254/516] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:39 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:41.169715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:41.170222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:41.176230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:41.176669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:41.177411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:41.177837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:41.314123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:41.323454 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:41.324956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:41.326106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ba7d7aba-f060-4d32-a25f-a8eb19602ccd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.160387 Jun 06 12:08:41.326665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 263/517] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:41 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:42.344544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:42.345161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:42.351695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:42.352149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:42.353599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:42.354039 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:42.481905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:42.490257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:42.491793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:42.492940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0fc66b6c-d3f9-43a2-9692-adc186bd3aae tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.152575 Jun 06 12:08:42.493492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 255/518] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:42 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:43.511669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:43.512280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:43.518742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:43.519264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:43.520038 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:43.520501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:43.726974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:43.735930 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:43.737427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:43.738599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7e56a02c-7498-42b8-8608-17833def2056 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.231251 Jun 06 12:08:43.739193 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 264/519] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:43 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:44.128810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:44.129851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:44.136713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.137164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.137937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.138375 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.162032 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'flavor' on Instance uuid 40878e79-b477-49b5-a24b-d593f6c4531b {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:08:44.288957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e52814b2-a735-47f8-a93d-e4cd33dc655a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/action" status: 200 len: 32 microversion: 2.1 time: 0.163948 Jun 06 12:08:44.289486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 256/520] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:08:44 2022] POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:08:44.298319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:44.298948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:44.305463 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.306061 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.306884 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.307407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.434401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:44.442395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78543c81-4c60-4d10-bd7c-0217d15e0e35 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.147763 Jun 06 12:08:44.442969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 265/521] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:44 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:44.758060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:44.759414 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:44.765790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.766249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.767052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:44.767491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:44.911132 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:44.920458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:44.921971 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:44.923194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7390b3b3-4b95-499c-907c-913d4baab226 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.169377 Jun 06 12:08:44.923804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 257/522] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:44 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:45.460107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:45.460758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:45.464245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=42 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:45.470199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:45.470643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:45.471494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:45.471921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:45.569909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-3298ab3d-b5e0-4b7e-9a06-82679546a173 req-2e1b5524-1553-4bef-b864-c35b335751cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "name": "network-vif-plugged", "status": "completed", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:08:45.580335 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3298ab3d-b5e0-4b7e-9a06-82679546a173 req-2e1b5524-1553-4bef-b864-c35b335751cb service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:45.580771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3298ab3d-b5e0-4b7e-9a06-82679546a173 req-2e1b5524-1553-4bef-b864-c35b335751cb service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:45.592010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:45.594126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-3298ab3d-b5e0-4b7e-9a06-82679546a173 req-2e1b5524-1553-4bef-b864-c35b335751cb service nova] Creating event network-vif-plugged:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:08:45.600264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-3298ab3d-b5e0-4b7e-9a06-82679546a173 req-2e1b5524-1553-4bef-b864-c35b335751cb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034594 Jun 06 12:08:45.601284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 258/523] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:08:45.622587 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:45.630796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e9042b6f-6534-4394-9ebb-c73ba9ef279b tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.174578 Jun 06 12:08:45.631479 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 266/524] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:45 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:45.942723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:45.943465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:45.951608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:45.952050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:45.952809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:45.953240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:46.083427 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:46.093355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:46.095206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:46.096837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-366acd3e-6513-462d-8e5c-fa66d9722a23 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.158170 Jun 06 12:08:46.108873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 259/525] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:45 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:46.649473 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:46.650086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:46.656058 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:46.656503 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:46.657256 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:46.657691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:46.787940 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:46.796730 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96f63b8c-61ad-41b6-92d2-5acad9bb6962 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.150950 Jun 06 12:08:46.797307 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 267/526] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:46 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:47.115626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:47.116286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:47.122960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:47.123405 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:47.124211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:47.124602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:47.265284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:47.273639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:47.275717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:47.276849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aba4e4b7-3498-45b3-a3cc-f0bd2af1817e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.165131 Jun 06 12:08:47.277408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 260/527] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:47 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:47.817445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:47.817999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:47.825268 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:47.825712 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:47.826492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:47.826957 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:47.965953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:47.974264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cce2af74-4a11-4080-b7a4-296b9976159c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.160727 Jun 06 12:08:47.974851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 268/528] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:47 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:48.295646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:48.296251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:48.302869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:48.303315 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:48.304086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:48.304516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:48.484342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:48.494439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:48.495964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:48.497143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f04ff08a-c845-4626-aecf-0ddfdab7d759 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.205389 Jun 06 12:08:48.497696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 261/529] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:48 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:48.991994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:48.992618 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:48.998916 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:48.999361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:49.000108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:49.000556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:49.020515 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:08:49.129377 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:49.137810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b333f27c-97f2-4fbf-90ad-b9c0726f0dd4 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.149638 Jun 06 12:08:49.138367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 269/530] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:48 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:49.515784 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:49.516397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:49.523533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:49.523984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:49.524944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:49.525382 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:49.664039 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:49.673050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:49.674542 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:49.675710 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a713b076-39c8-42dc-b0e3-c1f415db8277 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1807 microversion: 2.20 time: 0.163834 Jun 06 12:08:49.676280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 262/531] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:49 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:08:50.156312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:50.156969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:50.163158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:50.163605 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:50.164356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:50.164789 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:50.293331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:50.301181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-569f1f0e-88f5-47e7-b271-248e89fc72cf tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.148832 Jun 06 12:08:50.301746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 270/532] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:50 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:50.697149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:50.697766 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:50.704294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:50.704746 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:50.705506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:50.705943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:50.837191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:50.845791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:50.847347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:50.848499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-35b6602f-1847-4059-a997-e2e481a0bd44 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1794 microversion: 2.20 time: 0.157069 Jun 06 12:08:50.849064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 263/533] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:08:50 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:08:51.318115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:51.318726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:51.324978 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:51.325424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:51.326179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:51.326639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:51.456391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:51.464953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2600c58f-962e-4b2a-9d4b-bb0c398c78fe tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.150710 Jun 06 12:08:51.465785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 271/534] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:51 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:52.483377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:52.483979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:52.490657 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:52.491134 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:52.491894 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:52.492322 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:52.624177 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:52.632052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c10edb91-7405-4317-97b5-4aa4b814b53f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.152834 Jun 06 12:08:52.632619 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 264/535] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:52 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:53.649850 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:53.650498 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:53.656677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:53.657119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:53.657875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:53.658310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:53.788732 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:53.797339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-310d53b8-7bd0-4009-bd61-b9b07762efd9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.151835 Jun 06 12:08:53.797900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 272/536] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:53 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:54.814797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:54.815460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:54.822284 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:54.822730 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:54.823517 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:54.823954 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:54.952613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:54.960578 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-54c0716b-95fd-4233-a116-e37a39230b47 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.149738 Jun 06 12:08:54.961155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 265/537] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:54 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:56.078681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:56.079322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:56.085249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:56.085699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:56.086453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:56.087461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:56.217293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:56.225098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2d79a975-369f-4770-8cc1-53eb6bb6d6d3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.250722 Jun 06 12:08:56.225658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 273/538] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:55 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:57.242471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:57.243736 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:57.250420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:57.250884 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:57.251646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:57.252075 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:57.384758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:57.392622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-36ad674d-7a42-4d5b-8e80-643047bb3432 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.154119 Jun 06 12:08:57.393191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 266/539] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:57 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:58.410492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:58.411129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:58.417655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:58.418091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:58.418851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:58.419292 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:58.551950 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:58.560690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e3b21709-cf7b-4ef1-950c-5bd6501ce9e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.153989 Jun 06 12:08:58.561250 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 274/540] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:58 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:08:59.577889 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:08:59.578494 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:08:59.585055 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:59.585536 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:59.586324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:08:59.586807 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:08:59.719098 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:08:59.727199 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c903d891-eb54-46ca-92c6-e19ca9170601 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.153118 Jun 06 12:08:59.727769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 267/541] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:08:59 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:00.744530 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:00.745077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:00.751131 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:00.751572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:00.752319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:00.752749 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:00.882250 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:00.891026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ee7393ec-8f16-4548-9b0e-1eca75129d5c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.150547 Jun 06 12:09:00.891585 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 275/542] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:00 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:01.910060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:01.910682 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:01.917936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:01.918389 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:01.919278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:01.919694 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:02.058214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:02.066347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f6148ab-417f-4b05-8531-85caed173b98 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.160248 Jun 06 12:09:02.066963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 268/543] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:01 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:03.001825 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:09:03.002504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:09:03.084429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:03.085107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:03.091417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:03.091864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:03.092627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:03.093092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:03.218105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:03.225981 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-204dbb93-045e-4502-a93a-ee5da36ab1e5 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.145496 Jun 06 12:09:03.226541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 276/544] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:03 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:04.243469 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:04.244082 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:04.251547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:04.251990 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:04.252753 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:04.253190 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:04.381891 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:04.390447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-81e6e75c-139f-4dcf-96bf-9a3222d2a887 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1735 microversion: 2.1 time: 0.150844 Jun 06 12:09:04.391035 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 269/545] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:04 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:05.407921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:05.408531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:05.414690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.415179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.415988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.416590 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.559952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:05.567891 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a7b84c2e-cbb4-4b11-a208-d9df60dd062c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1715 microversion: 2.1 time: 0.163826 Jun 06 12:09:05.568461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 277/546] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:05 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:05.621639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:05.622238 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:05.628606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.629047 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.629797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.630235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.752156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] HTTP exception thrown: Cannot 'detach_volume' instance 40878e79-b477-49b5-a24b-d593f6c4531b while it is in vm_state rescued Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Request method failure captured: Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments/272e0b32-e224-4eb0-860f-f7e3e6d5ffbd HTTP/1.1 Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0sqgscjiYsCiYUYsl0n0mA6SRjuwMz1_ipHPhe-MsEFs5zc4RSb8fbJ0H5qag0P3vEc5Sl_HC8MbYna4KYlh7hF-Yc82-WPWYh2Brs9Lv9UuVLsArj4xFZ2Qj9tQoR5sKk4xyuuVkAd2xge7Clytqv55M2JjnDhXvlRo5hHDT1EnE Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:09:05.753761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cf5de9215c3243e1b2fabc859f102b2a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 473532c21cad4c3492c8425855993b0f Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:09:05.755150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Cannot 'detach_volume' instance 40878e79-b477-49b5-a24b-d593f6c4531b while it is in vm_state rescued Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '40878e79-b477-49b5-a24b-d593f6c4531b', 'id': '272e0b32-e224-4eb0-860f-f7e3e6d5ffbd'} Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40878e79-b477-49b5-a24b-d593f6c4531b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:09:05.755837 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 40878e79-b477-49b5-a24b-d593f6c4531b while it is in vm_state rescued Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 40878e79-b477-49b5-a24b-d593f6c4531b while it is in vm_state rescued Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:05.757278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Returning 409 to user: Cannot 'detach_volume' instance 40878e79-b477-49b5-a24b-d593f6c4531b while it is in vm_state rescued {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:09:05.758544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0cad3529-e234-4c76-b1a1-0faa7a86c608 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments/272e0b32-e224-4eb0-860f-f7e3e6d5ffbd" status: 409 len: 152 microversion: 2.1 time: 0.137511 Jun 06 12:09:05.758544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 270/547] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:09:05 2022] DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments/272e0b32-e224-4eb0-860f-f7e3e6d5ffbd => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 12:09:05.764088 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:05.764737 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:05.770647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.771131 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.771900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.772336 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.841309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c76c0fc6-304d-4eca-9fea-007b8582e572 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/action" status: 202 len: 0 microversion: 2.1 time: 0.081018 Jun 06 12:09:05.841949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 278/548] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:09:05 2022] POST /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:05.849925 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:05.850538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:05.857642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.858095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.858892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:05.859333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:05.986922 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:05.995658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4b8fb0a-65ad-4aec-a8ab-4b11bf3359dd tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1723 microversion: 2.1 time: 0.149434 Jun 06 12:09:05.996296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 271/549] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:05 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:07.014890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:07.015597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:07.021846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:07.022319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:07.023117 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:07.023553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:07.159181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:07.167685 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-821a3cec-a93f-43cc-b282-dc8029f5868f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1723 microversion: 2.1 time: 0.158079 Jun 06 12:09:07.168241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 279/550] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:07 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:08.184748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:08.185361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:08.187696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=39 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:08.193688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:08.194138 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:08.194951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:08.195392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:08.325426 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:08.333250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f1514f32-8b11-4b9e-a412-2b4ec1cc132f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1723 microversion: 2.1 time: 0.152599 Jun 06 12:09:08.333806 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 272/551] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:08 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:09.352137 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:09.352742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:09.359907 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:09.360350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:09.361097 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:09.361523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:09.490677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:09.499148 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cde66077-8836-4e80-a217-ed2647fc3b8c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1723 microversion: 2.1 time: 0.150867 Jun 06 12:09:09.499710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 280/552] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:09 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:10.515418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:10.516027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:10.522556 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:10.523041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:10.523804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:10.524236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:10.649587 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:10.657762 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0b04c17b-c969-4437-9eeb-3e530af44650 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1729 microversion: 2.1 time: 0.146183 Jun 06 12:09:10.658332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 273/553] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:10 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:10.674558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:10.675096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:10.681054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:10.682076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:10.682854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:10.683363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:10.758057 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2df975a0-e9c4-4412-8955-a98502d692c8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087276 Jun 06 12:09:10.758651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 281/554] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:09:10 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:11.888145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-17f986e3-6a99-4f30-8292-5de9377f3f42 req-eb1d7e4e-4c9a-4f89-9cf1-e9bb8786c88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:11.896534 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-17f986e3-6a99-4f30-8292-5de9377f3f42 req-eb1d7e4e-4c9a-4f89-9cf1-e9bb8786c88a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:11.896980 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-17f986e3-6a99-4f30-8292-5de9377f3f42 req-eb1d7e4e-4c9a-4f89-9cf1-e9bb8786c88a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:11.908581 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-17f986e3-6a99-4f30-8292-5de9377f3f42 req-eb1d7e4e-4c9a-4f89-9cf1-e9bb8786c88a service nova] Creating event network-changed:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:09:11.913771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-17f986e3-6a99-4f30-8292-5de9377f3f42 req-eb1d7e4e-4c9a-4f89-9cf1-e9bb8786c88a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091630 Jun 06 12:09:11.914352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 274/555] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:13.928382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-2d6de8d4-1469-4fc1-a911-24f1db140d14 req-c69144cc-82b5-4cf9-944a-d32530b50482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:13.936480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-2d6de8d4-1469-4fc1-a911-24f1db140d14 req-c69144cc-82b5-4cf9-944a-d32530b50482 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:13.936916 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-2d6de8d4-1469-4fc1-a911-24f1db140d14 req-c69144cc-82b5-4cf9-944a-d32530b50482 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:13.947811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-2d6de8d4-1469-4fc1-a911-24f1db140d14 req-c69144cc-82b5-4cf9-944a-d32530b50482 service nova] Creating event network-changed:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:09:13.952771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-2d6de8d4-1469-4fc1-a911-24f1db140d14 req-c69144cc-82b5-4cf9-944a-d32530b50482 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028136 Jun 06 12:09:13.953411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 282/556] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:29.448823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=5 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:29.449559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=93 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:29.557154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:29.557741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:29.563898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:29.564341 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:29.565088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:29.565524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:29.643647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lazy-loading 'services' on Instance uuid 75ad39f5-7b1d-4a44-b425-4742770b160a {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:09:29.757827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-88562a1b-b6b5-4dad-8b04-76f5ba961d18 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments/9fda2acf-dd2f-4084-9959-79d09cab503a" status: 202 len: 0 microversion: 2.1 time: 0.310961 Jun 06 12:09:29.758489 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 275/557] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:09:29 2022] DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments/9fda2acf-dd2f-4084-9959-79d09cab503a => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:31.919513 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=33 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:31.920314 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:31.924373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-049835ca-d1cc-4317-a1c2-4faecefc2510 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:31.931680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049835ca-d1cc-4317-a1c2-4faecefc2510 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:31.932123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-049835ca-d1cc-4317-a1c2-4faecefc2510 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:31.992823 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-049835ca-d1cc-4317-a1c2-4faecefc2510 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Going to try to stop instance {{(pid=117629) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 12:09:32.036738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-049835ca-d1cc-4317-a1c2-4faecefc2510 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action" status: 202 len: 0 microversion: 2.1 time: 0.118035 Jun 06 12:09:32.037359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 283/558] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:09:31 2022] POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:32.047408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:32.048147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:32.054940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:32.055392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:32.056394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:32.057058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:32.194085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:32.202438 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-df143615-3410-470b-8e64-2f5ff1a0fca2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.160648 Jun 06 12:09:32.203022 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 276/559] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:32 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:33.220644 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:33.221376 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:33.227679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:33.228846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:33.229627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:33.230060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:33.388423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:33.398727 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-75cff5ce-0e41-4b18-9a25-94cd2a3a14f8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.181071 Jun 06 12:09:33.399335 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 284/560] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:33 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:34.120814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:34.121317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:34.127272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.127718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.128474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.128925 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.152697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ad3a96c8-c596-44f7-836e-ef96ef8e141e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/ips" status: 200 len: 149 microversion: 2.1 time: 0.086157 Jun 06 12:09:34.153245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 277/561] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:09:34 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/ips => generated 149 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:34.163840 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d4d4ba7-81b9-4db9-a587-6493499b66cf"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:34.164904 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:34.171024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.171466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.172216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.172642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.254459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/os-volume_attachments HTTP/1.1 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 74 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:09:34.257226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {"volumeAttachment": {"volumeId": "5d4d4ba7-81b9-4db9-a587-6493499b66cf"}} Jun 06 12:09:34.258611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'server_id': '350245e3-005d-45bf-92e0-788b04a2416c', 'body': {'volumeAttachment': {'volumeId': '5d4d4ba7-81b9-4db9-a587-6493499b66cf'}}} Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:09:34.260241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:34.261736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 400 to user: Invalid volume: volume 5d4d4ba7-81b9-4db9-a587-6493499b66cf is already attached to instances: c3895721-6514-401d-aa5d-b36908cf8708 {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8ffd2e19-1e23-45c1-ab11-a24a91f74e5d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100684 Jun 06 12:09:34.263342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 285/562] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:09:34 2022] POST /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:09:34.270144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:34.270767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:34.277512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.278043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.278800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.279258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.303216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:09:34.393374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-070aaabb-11fc-4a77-a180-253b93a134d0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 204 len: 0 microversion: 2.1 time: 0.126708 Jun 06 12:09:34.394069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 278/563] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:09:34 2022] DELETE /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:09:34.403381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:34.404784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:34.411007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.411452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.412219 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.412683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.422422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:34.423137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:34.429062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.429504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.430259 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:34.430744 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:34.610512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:34.617122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:34.617969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-32b3b348-244b-434d-bee1-fe731a6e6143 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1680 microversion: 2.1 time: 0.219031 Jun 06 12:09:34.619085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 286/564] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:34 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:34.625195 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d6fb8b9b-f15b-468a-ade2-c41c7f5579e0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.207910 Jun 06 12:09:34.625756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 279/565] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:34 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:35.637078 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:35.637750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:35.642862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:35.643471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:35.643734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:35.644171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:35.644961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:35.645386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:35.650571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:35.651058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:35.651824 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:35.652262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:35.850205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:35.853858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:35.857809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-35e6195b-48da-4799-ac50-6bf47d5f449d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.218760 Jun 06 12:09:35.858576 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 280/566] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:35 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:35.861203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-face3ce2-4150-42d1-99ed-2ade84945edd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1680 microversion: 2.1 time: 0.228838 Jun 06 12:09:35.861751 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 287/567] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:35 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:36.875307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:36.875932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:36.880115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:36.880941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:36.882404 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:36.882829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:36.883637 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:36.884122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:36.887290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:36.887745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:36.888520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:36.888953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:37.086623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:37.091090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:37.096121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b82eb26f-11ee-46fc-b5a3-514e65f3146d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 200 len: 1680 microversion: 2.1 time: 0.219927 Jun 06 12:09:37.096899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 288/568] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:36 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:37.098997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e1687950-284a-4516-8ec0-a2a145e5962d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.227602 Jun 06 12:09:37.099712 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 281/569] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:36 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:37.572363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ed566e18-dfd7-4966-b232-b70e5117f8fa req-72adf439-a7fb-482e-8ab3-20418679da4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "350245e3-005d-45bf-92e0-788b04a2416c", "name": "network-vif-deleted", "tag": "949f8eae-651f-4414-8e62-d9044117dae6"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:37.581733 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ed566e18-dfd7-4966-b232-b70e5117f8fa req-72adf439-a7fb-482e-8ab3-20418679da4a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:37.582530 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ed566e18-dfd7-4966-b232-b70e5117f8fa req-72adf439-a7fb-482e-8ab3-20418679da4a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:37.595104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ed566e18-dfd7-4966-b232-b70e5117f8fa req-72adf439-a7fb-482e-8ab3-20418679da4a service nova] Creating event network-vif-deleted:949f8eae-651f-4414-8e62-d9044117dae6 for instance 350245e3-005d-45bf-92e0-788b04a2416c on hv-cinder-82549 Jun 06 12:09:37.603654 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ed566e18-dfd7-4966-b232-b70e5117f8fa req-72adf439-a7fb-482e-8ab3-20418679da4a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107070 Jun 06 12:09:37.604525 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 289/570] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:38.116633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:38.121222 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:38.122672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:38.123477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:38.133803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.138774 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.139450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:38.140173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:38.141145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.142159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.142787 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:38.143432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:38.162732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c HTTP/1.1 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:09:38.165810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:09:38.167160 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '350245e3-005d-45bf-92e0-788b04a2416c'} Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:09:38.167877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:09:38.169758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:38.170826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:09:38.170826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e459c158-1f0f-4b70-b4a1-67acb9d5722e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 404 len: 111 microversion: 2.1 time: 0.058774 Jun 06 12:09:38.170826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 282/571] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:38 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:09:38.176979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b129ba11-46eb-46af-84b4-07c2c454312e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '.version_select at 0x7fc15b6cf0d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:38.211520 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b129ba11-46eb-46af-84b4-07c2c454312e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780275115" status: 202 len: 0 microversion: 2.1 time: 0.038090 Jun 06 12:09:38.213163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 283/572] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 12:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780275115 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:38.316574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:38.325127 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2d228e3f-7c7f-4a29-9021-616c2b5f69a0 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.212546 Jun 06 12:09:38.326242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 290/573] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:38 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:38.976778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:38.977279 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:38.984645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.985094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:38.985858 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:38.986321 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:39.081539 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lazy-loading 'services' on Instance uuid c3895721-6514-401d-aa5d-b36908cf8708 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:09:39.159043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2065a036-d82f-4c38-8876-36bd73696de2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments/5d4d4ba7-81b9-4db9-a587-6493499b66cf" status: 202 len: 0 microversion: 2.1 time: 0.186028 Jun 06 12:09:39.160043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 284/574] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:09:38 2022] DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments/5d4d4ba7-81b9-4db9-a587-6493499b66cf => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:39.171211 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:39.172224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:39.180103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:39.180725 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:39.181528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:39.182287 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:39.213517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-94529b65-1e3b-41f0-b98c-5f103fe1b409 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049133 Jun 06 12:09:39.214273 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 291/575] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:09:39 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:39.343011 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:39.343926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:39.350491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:39.351049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:39.351886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:39.352393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:39.496684 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:39.504203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-21652ccd-ae4f-481f-aeb3-b67649912ec4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.165738 Jun 06 12:09:39.504774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 285/576] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:39 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:40.226220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:40.227390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:40.234676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.235163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.236003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.236440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.266110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c1d45529-b46f-4294-a946-673618946d82 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044920 Jun 06 12:09:40.266666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 292/577] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:09:40 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:09:40.323228 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:40.323720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:40.330113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.330555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.331348 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.331782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.359435 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:09:40.431899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2891976c-786d-468e-bd9d-5cfd0bf94905 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 204 len: 0 microversion: 2.1 time: 0.112250 Jun 06 12:09:40.432492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 286/578] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:09:40 2022] DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:09:40.440824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:40.441443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:40.447886 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.448337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.449100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.449539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.522208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:40.522798 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:40.529546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.529996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.530767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:40.531226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:40.615395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:40.623509 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-eabb0113-caa5-4d28-af6f-48c3906e7e88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1680 microversion: 2.1 time: 0.186533 Jun 06 12:09:40.624220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 293/579] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:40 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:40.682616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:40.690403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-af9fcc3e-4337-44a4-820f-4454383e2f69 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.172551 Jun 06 12:09:40.691009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 287/580] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:40 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:41.640842 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:41.641452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:41.647485 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:41.647930 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:41.648707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:41.649147 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:41.707815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:41.708420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:41.715370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:41.715814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:41.716576 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:41.717043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:41.823263 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:41.831245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dda1bb7d-0d5e-44d0-bc6d-c82c71fb141f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1680 microversion: 2.1 time: 0.194163 Jun 06 12:09:41.832013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 294/581] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:41 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:41.871485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:41.874978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:41.879773 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9aa419cf-d2e3-4cbe-8e3e-55c1f58a892d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.175827 Jun 06 12:09:41.880346 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 288/582] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:41 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:42.550371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-3c9b6f8f-b538-4641-80af-d5efbb5715ff req-b6b2742f-0ca6-4eeb-8dc2-797831f825bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3895721-6514-401d-aa5d-b36908cf8708", "name": "network-vif-deleted", "tag": "fe928e02-5f64-4f96-a62c-91ca4aa8d795"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:42.564173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3c9b6f8f-b538-4641-80af-d5efbb5715ff req-b6b2742f-0ca6-4eeb-8dc2-797831f825bd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.564630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3c9b6f8f-b538-4641-80af-d5efbb5715ff req-b6b2742f-0ca6-4eeb-8dc2-797831f825bd service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.578506 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-3c9b6f8f-b538-4641-80af-d5efbb5715ff req-b6b2742f-0ca6-4eeb-8dc2-797831f825bd service nova] Creating event network-vif-deleted:fe928e02-5f64-4f96-a62c-91ca4aa8d795 for instance c3895721-6514-401d-aa5d-b36908cf8708 on hv-cinder-82549 Jun 06 12:09:42.583556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-3c9b6f8f-b538-4641-80af-d5efbb5715ff req-b6b2742f-0ca6-4eeb-8dc2-797831f825bd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038533 Jun 06 12:09:42.584400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 295/583] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:42.849404 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:42.850095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:42.858329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.858769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.859676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.860290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.890870 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.891734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.891876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lazy-loading 'fault' on Instance uuid c3895721-6514-401d-aa5d-b36908cf8708 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:09:42.897574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:42.898390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:42.905536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.905984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.906929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:42.907352 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:42.938014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:42.946065 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-601d4355-2bc9-4f1c-901b-9726a233bb72 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 200 len: 1330 microversion: 2.1 time: 0.100646 Jun 06 12:09:42.946649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 289/584] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:42 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:43.051133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:43.059475 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0817d886-8150-4aa0-bc34-5b85ca42e35c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.166388 Jun 06 12:09:43.060048 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 296/585] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:42 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:43.963592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:43.964118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:43.970816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:43.971293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:43.972051 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:43.972486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:43.985909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 HTTP/1.1 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:09:43.987549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:09:43.989074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'c3895721-6514-401d-aa5d-b36908cf8708'} Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:09:43.990113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:09:43.991547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:09:43.992846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:09:43.992846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-508a69bd-5e6d-45df-aed4-a7948b7a2001 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 404 len: 111 microversion: 2.1 time: 0.029406 Jun 06 12:09:43.992846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 290/586] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:43 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:09:43.998607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-332fce63-e80f-4011-9b5b-95b86b1a2ae5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '.version_select at 0x7fc1680c2430>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:44.018330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-332fce63-e80f-4011-9b5b-95b86b1a2ae5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811249727" status: 202 len: 0 microversion: 2.1 time: 0.023467 Jun 06 12:09:44.018934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 297/587] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 12:09:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811249727 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:09:44.077070 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:44.077829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:44.083893 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:44.084347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:44.085110 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:44.085546 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:44.253148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:44.261688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a2f5269-d6a8-4e41-8bb4-6c6ab8913582 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.188552 Jun 06 12:09:44.263024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 291/588] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:44 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:44.930178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a9f30c9c-064a-4db9-9bd4-26e99d6762d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: .version_select at 0x7fc1689863a0>, body: {"keypair": {"name": "tempest-keypair-1171119986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPV2w338wdy5wS+ge1tp9U8WC8/cysakjXCs+alqMQ9MvPX9Eb++QlPT0WpEGRbEe6Z2QyXve8phWWpPh6bqXvyfBBfZSbkLXGvnFWS86UGtCzFtAvJEdN3noL9cStQiWQ=="}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:44.944062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-a9f30c9c-064a-4db9-9bd4-26e99d6762d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:09:44.948090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-a9f30c9c-064a-4db9-9bd4-26e99d6762d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:09:44.969449 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a9f30c9c-064a-4db9-9bd4-26e99d6762d8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043202 Jun 06 12:09:44.970033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 298/589] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:09:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:45.280308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:45.281112 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:45.287706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:45.288151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:45.288918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:45.289360 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:45.510344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:45.518101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-34ce5a05-681a-427d-a577-d5999100f134 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.241666 Jun 06 12:09:45.518685 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 292/590] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:45 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:46.288048 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1538041539", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7652b7b-d4f4-4b94-9492-ad0df97f85c2"}], "security_groups": [{"name": "tempest-securitygroup--885172965"}], "key_name": "tempest-keypair-1171119986", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:46.396886 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] validate_networks() for [('f7652b7b-d4f4-4b94-9492-ad0df97f85c2', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:09:46.535741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:46.537071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:46.544904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:46.545363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:46.546143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:46.546583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:46.742641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:46.752461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1112fb47-7871-4207-a298-bcf3858338d3 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1678 microversion: 2.1 time: 0.220354 Jun 06 12:09:46.753155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 293/591] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:46 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:46.872936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:09:46.873356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:09:46.873829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:09:46.874237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:09:46.874677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:09:46.883444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:46.883992 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:46.884949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:46.885383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:46.901672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:09:46.905755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:09:46.917253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:09:46.919572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:09:46.967970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bd21c8e8-e44e-4a75-b0b2-bb030435d41e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684185 Jun 06 12:09:46.968890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 299/592] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:09:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:09:46.979840 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a1367171-2c45-4682-b5ff-d295a7479232 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:46.980462 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a1367171-2c45-4682-b5ff-d295a7479232 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:47.039108 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a1367171-2c45-4682-b5ff-d295a7479232 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:47.047396 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a1367171-2c45-4682-b5ff-d295a7479232 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1242 microversion: 2.1 time: 0.072310 Jun 06 12:09:47.048161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 294/593] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:46 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:47.769715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:47.770275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:47.777794 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:47.778237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:47.779056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:47.779547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:47.910399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:47.917823 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0deac7ba-dd8c-4013-9c38-8ef9d4bb5039 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1655 microversion: 2.1 time: 0.152114 Jun 06 12:09:47.918383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 300/594] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:47 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:47.934566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2b99027a-9e3d-4cff-a7f1-4cf6b022ddc1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:47.941101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b99027a-9e3d-4cff-a7f1-4cf6b022ddc1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:47.941552 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2b99027a-9e3d-4cff-a7f1-4cf6b022ddc1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:47.964398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2b99027a-9e3d-4cff-a7f1-4cf6b022ddc1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Going to try to start instance {{(pid=117630) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 12:09:48.005794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2b99027a-9e3d-4cff-a7f1-4cf6b022ddc1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action" status: 202 len: 0 microversion: 2.1 time: 0.075449 Jun 06 12:09:48.006651 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 295/595] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:09:47 2022] POST /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 12:09:48.018803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:48.019234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:48.027034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:48.027686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:48.028531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:48.029683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:48.066904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fab385e7-ba13-43d8-b397-0efc90de8325 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:48.067613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fab385e7-ba13-43d8-b397-0efc90de8325 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:48.160816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fab385e7-ba13-43d8-b397-0efc90de8325 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:48.174824 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fab385e7-ba13-43d8-b397-0efc90de8325 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1242 microversion: 2.1 time: 0.112403 Jun 06 12:09:48.175278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 296/596] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:48 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:09:48.216917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:48.224486 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c4a1b925-13f5-422e-9bb2-7d2c5c209264 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1664 microversion: 2.1 time: 0.210630 Jun 06 12:09:48.225051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 301/597] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:48 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1664 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:49.193508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2083ba2f-d758-400d-b0da-247dfccea95d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:49.194104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2083ba2f-d758-400d-b0da-247dfccea95d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:49.245766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:49.248039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:49.248658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2083ba2f-d758-400d-b0da-247dfccea95d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:49.255472 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:49.255678 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2083ba2f-d758-400d-b0da-247dfccea95d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1242 microversion: 2.1 time: 0.066802 Jun 06 12:09:49.256046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:49.256252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 297/598] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:49 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:49.265046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:49.265569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:49.284870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:49.407115 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:49.415230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c9f1719e-0863-4582-beac-52440417dc83 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1664 microversion: 2.1 time: 0.175518 Jun 06 12:09:49.416011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 302/599] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:49 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1664 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:50.272444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7082bb05-4116-49b1-8493-3682a0ab0563 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:50.272993 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7082bb05-4116-49b1-8493-3682a0ab0563 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:50.326439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7082bb05-4116-49b1-8493-3682a0ab0563 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:50.333175 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7082bb05-4116-49b1-8493-3682a0ab0563 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1242 microversion: 2.1 time: 0.064699 Jun 06 12:09:50.333751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 298/600] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:50 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:50.433740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:50.434359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:50.440719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:50.441116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:50.441890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:50.442374 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:50.569318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:50.576892 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d5c4ae66-db05-47c7-8efb-04432cf44245 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1668 microversion: 2.1 time: 0.147875 Jun 06 12:09:50.577456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 303/601] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:50 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:51.353706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:51.354316 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:51.361745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:51.362192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:51.363055 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:51.363521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:51.432678 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:51.440896 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e1af239-ac35-44df-85c7-d8299db3a15e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1246 microversion: 2.1 time: 0.091566 Jun 06 12:09:51.441513 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 299/602] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:51 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:52.457539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:52.458149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:52.465130 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:52.465571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:52.466327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:52.466759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:52.732437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:52.740080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-751abc0c-c794-468c-b7f7-4c1aa6ec36fa tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1300 microversion: 2.1 time: 0.286391 Jun 06 12:09:52.740979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 304/603] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:52 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1300 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:53.668748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-fd84da70-e0d6-469e-bc19-8d85be9b4750 req-11b36e71-4372-4c90-aa7d-375bf3a93de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2882d4e-8691-4d0b-abf9-7fd49d8802c2", "tag": "eb486d46-6c82-4ab7-9d76-3c9b15760cbd"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:09:53.677829 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fd84da70-e0d6-469e-bc19-8d85be9b4750 req-11b36e71-4372-4c90-aa7d-375bf3a93de7 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:53.678282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fd84da70-e0d6-469e-bc19-8d85be9b4750 req-11b36e71-4372-4c90-aa7d-375bf3a93de7 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:53.693224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-fd84da70-e0d6-469e-bc19-8d85be9b4750 req-11b36e71-4372-4c90-aa7d-375bf3a93de7 service nova] Creating event network-changed:eb486d46-6c82-4ab7-9d76-3c9b15760cbd for instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 on hv-cinder-82549 Jun 06 12:09:53.698963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-fd84da70-e0d6-469e-bc19-8d85be9b4750 req-11b36e71-4372-4c90-aa7d-375bf3a93de7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037582 Jun 06 12:09:53.699939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 300/604] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:09:53.757422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:53.758034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:53.765015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:53.765639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:53.766401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:53.766879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:53.907524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:53.915954 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cd12d4c8-9ba7-4eb7-bc40-ea1e873223a4 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.162539 Jun 06 12:09:53.916536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 305/605] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:53 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:54.933802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:54.934525 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:54.940720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:54.941159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:54.941929 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:54.942356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:55.074247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:55.081530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f023f3ce-2746-426a-aa81-b6f616ac7628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.152439 Jun 06 12:09:55.082097 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 301/606] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:54 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:56.099574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:56.100179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:56.106626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:56.107100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:56.107876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:56.108307 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:56.233258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:56.240708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c291609b-6427-493d-823d-ee92ae36fd05 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.145039 Jun 06 12:09:56.241300 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 306/607] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:56 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:57.259200 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:57.259716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:57.266151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.266594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:57.267369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.267800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:57.400226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:57.407616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c7041083-a681-4ed0-845f-a8d1796bf659 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.152904 Jun 06 12:09:57.408186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 302/608] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:57 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:57.744438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:57.745165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=10 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:57.846745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:57.847269 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:57.853575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.854016 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:57.854779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.855375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:57.888599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5d0aa881-bc81-456a-a83e-1470a710b1c7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments/a8da16c9-28a8-48be-a0a6-5bfcd8e6d7e5" status: 200 len: 194 microversion: 2.20 time: 0.149138 Jun 06 12:09:57.889174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 307/609] 10.222.0.41 () {60 vars in 1453 bytes} [Mon Jun 6 12:09:57 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments/a8da16c9-28a8-48be-a0a6-5bfcd8e6d7e5 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:09:57.952004 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:57.952504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:57.958442 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.958911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:57.959672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:57.960120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:58.201294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lazy-loading 'services' on Instance uuid 4a952182-3969-4289-8b82-48c462c44f9d {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:09:58.271175 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-73a35e13-484b-48b0-9409-d9c428f77223 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments/a8da16c9-28a8-48be-a0a6-5bfcd8e6d7e5" status: 202 len: 0 microversion: 2.20 time: 0.322883 Jun 06 12:09:58.271948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 303/610] 10.222.0.41 () {60 vars in 1456 bytes} [Mon Jun 6 12:09:57 2022] DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments/a8da16c9-28a8-48be-a0a6-5bfcd8e6d7e5 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:09:58.280572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:58.281604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:58.287926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:58.288412 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:58.289802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:58.290233 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:58.320666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dfb32c61-0bd7-4945-b086-8806c7c3f653 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043882 Jun 06 12:09:58.321207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 308/611] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 12:09:58 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:09:58.424538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:58.425264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:58.431791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:58.432237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:58.432987 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:58.433418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:58.565731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:58.573536 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fff1e95a-1ffa-4994-9b0d-988c1cd13628 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.153201 Jun 06 12:09:58.574116 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 304/612] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:58 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:59.332923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:59.333994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:59.340548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.341029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.341793 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.342225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.371848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-76ded2d6-1078-4141-9d0e-fbae5010a185 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043153 Jun 06 12:09:59.372405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 309/613] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 12:09:59 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:09:59.428156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:59.428675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:59.436176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.436628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.437392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.437828 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.463254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:09:59.521805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:09:59.540303 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2c5df08b-9a9c-4099-b45f-60d263de262e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 204 len: 0 microversion: 2.20 time: 0.115553 Jun 06 12:09:59.540821 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 305/614] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 12:09:59 2022] DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 12:09:59.548945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:59.549547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:59.555668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.556121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.556888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.557321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.591577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:09:59.592405 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:09:59.598767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.599252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.600028 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:09:59.600472 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:09:59.740200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:59.748468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:59.749976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:59.751140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1b6aef23-22fa-42f6-8dd0-e3a14ef5c548 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.206075 Jun 06 12:09:59.751693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 310/615] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:09:59 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:09:59.767094 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:09:59.775359 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bdcacc5e-aa25-4dcd-98be-59eb0b866e32 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.188120 Jun 06 12:09:59.775918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 306/616] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:09:59 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:00.048403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-95278456-6051-4708-9b63-22fa4218595a req-1338e056-f941-4df3-9b5e-e0f81f1070a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2882d4e-8691-4d0b-abf9-7fd49d8802c2", "name": "network-vif-plugged", "status": "completed", "tag": "eb486d46-6c82-4ab7-9d76-3c9b15760cbd"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:00.057343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-95278456-6051-4708-9b63-22fa4218595a req-1338e056-f941-4df3-9b5e-e0f81f1070a2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:00.057782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-95278456-6051-4708-9b63-22fa4218595a req-1338e056-f941-4df3-9b5e-e0f81f1070a2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:00.069114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-95278456-6051-4708-9b63-22fa4218595a req-1338e056-f941-4df3-9b5e-e0f81f1070a2 service nova] Creating event network-vif-plugged:eb486d46-6c82-4ab7-9d76-3c9b15760cbd for instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 on hv-cinder-82549 Jun 06 12:10:00.074584 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-95278456-6051-4708-9b63-22fa4218595a req-1338e056-f941-4df3-9b5e-e0f81f1070a2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089844 Jun 06 12:10:00.075202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 311/617] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:00.769420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:00.769947 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:00.771871 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:00.778618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:00.779098 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:00.780462 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:00.780462 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:00.784706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:00.793523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:00.794223 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:00.800615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:00.800941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:00.801802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:00.802221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:00.972407 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:00.981340 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:00.982909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:00.984084 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b50627b7-2b76-49b3-89c1-07b798cba8fc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.218651 Jun 06 12:10:00.984644 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 307/618] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:00 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:00.986502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:00.994062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0d6e33c5-ea93-41fc-a0b0-d4eac73c08fc tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.205451 Jun 06 12:10:00.994706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 312/619] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:00 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:02.003289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:02.003904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:02.010350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:02.010802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:02.011618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:02.012045 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:02.012461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:02.012656 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:02.014617 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:02.021782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:02.022222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:02.023041 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:02.023488 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:02.208628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:02.217646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:02.219184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:02.220358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a5727702-a36d-453a-b2a8-a82a0850a472 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1722 microversion: 2.20 time: 0.221206 Jun 06 12:10:02.220917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 308/620] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:01 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:02.223962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:02.232535 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03a4027c-e315-4914-bb50-c3f4c5e85bb7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.224939 Jun 06 12:10:02.233521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 313/621] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:02 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:03.238485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:03.239197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:03.246780 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:03.247259 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:03.248023 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:03.248454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:03.249628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:03.250265 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:03.256850 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:03.258172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:03.259400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:03.260044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:03.346688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:03.356809 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:03.358729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:03.360189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4ea7d77-c397-462f-9acc-5eb9f9436363 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 200 len: 1655 microversion: 2.20 time: 0.125776 Jun 06 12:10:03.361275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 309/622] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:03 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 1655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:03.365894 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-26c7bde6-6bc9-4a81-a6d2-f88f68dd9be2 req-54f18024-8efd-4131-a714-e4cabce3db94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a952182-3969-4289-8b82-48c462c44f9d", "name": "network-vif-deleted", "tag": "93ade8ef-fe20-40f1-8599-42fc67eb3080"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:03.380033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-26c7bde6-6bc9-4a81-a6d2-f88f68dd9be2 req-54f18024-8efd-4131-a714-e4cabce3db94 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:03.380683 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-26c7bde6-6bc9-4a81-a6d2-f88f68dd9be2 req-54f18024-8efd-4131-a714-e4cabce3db94 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:03.394594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-26c7bde6-6bc9-4a81-a6d2-f88f68dd9be2 req-54f18024-8efd-4131-a714-e4cabce3db94 service nova] Creating event network-vif-deleted:93ade8ef-fe20-40f1-8599-42fc67eb3080 for instance 4a952182-3969-4289-8b82-48c462c44f9d on hv-cinder-82549 Jun 06 12:10:03.402559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-26c7bde6-6bc9-4a81-a6d2-f88f68dd9be2 req-54f18024-8efd-4131-a714-e4cabce3db94 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039300 Jun 06 12:10:03.403496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 310/623] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:03.434095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:03.446458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b77598e3-137c-4fe3-81ae-2e5439b044a0 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1367 microversion: 2.1 time: 0.200338 Jun 06 12:10:03.447717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 314/624] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:03 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:04.380603 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:04.381541 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:04.387878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.388335 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.389113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.389551 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.403644 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d HTTP/1.1 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:10:04.405296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:10:04.406936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '4a952182-3969-4289-8b82-48c462c44f9d'} Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:04.411204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:10:04.412706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:04.414832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:04.414832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cdb3d1fe-9949-4d91-abfd-e6efe86e74a5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 404 len: 111 microversion: 2.20 time: 0.031276 Jun 06 12:10:04.414832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 311/625] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:04 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:10:04.416652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a25195b2-7baa-4f53-83c3-5452c4817499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '.version_select at 0x7fc1680c2f70>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:04.435248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a25195b2-7baa-4f53-83c3-5452c4817499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498578206" status: 204 len: 0 microversion: 2.20 time: 0.023378 Jun 06 12:10:04.436148 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 315/626] 10.222.0.41 () {60 vars in 1258 bytes} [Mon Jun 6 12:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498578206 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 06 12:10:04.465422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:04.466145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:04.473527 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.474119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.474995 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.475496 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.662140 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:04.670631 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-94496e5f-7e74-4ce6-96f9-57b655a61486 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1556 microversion: 2.1 time: 0.210648 Jun 06 12:10:04.671162 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 312/627] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:04 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:04.687625 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:04.688127 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:04.694448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.694965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.695806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:04.696243 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:04.775771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7112f76c-bdd6-4e9f-a9d7-85a4404d6838 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091993 Jun 06 12:10:04.777203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 316/628] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:10:04 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:05.380026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1bd4fa24-0ffc-41cc-b4db-9c7c738ec7ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: .version_select at 0x7fc15b73bd30>, body: {"keypair": {"name": "tempest-keypair-1529759032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlq7+l0scRtea60xzkR5UFX06gpnXWyOTf+GPMEci2tJkWsl7EvYm7V3Y6ahsxeMsRaaiW8nSVCAsh9mUiX+XoTJ+FtlvqUtEY6sN++ICWKwdD8mv006Kjw479+kmhItg=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:05.395532 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-1bd4fa24-0ffc-41cc-b4db-9c7c738ec7ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for project e4e76a3125df4436abf5f788e35d492f. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:10:05.399589 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-1bd4fa24-0ffc-41cc-b4db-9c7c738ec7ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for user c8bda0c079054e198ffeca4c0ac18bf2 and project e4e76a3125df4436abf5f788e35d492f. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:10:05.426286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1bd4fa24-0ffc-41cc-b4db-9c7c738ec7ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052723 Jun 06 12:10:05.426928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 313/629] 10.222.0.41 () {62 vars in 1199 bytes} [Mon Jun 6 12:10:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 12:10:05.808870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-5b9d1831-eb4a-41dc-9129-1d23519d0f99 req-068daa21-16fb-4dac-be18-69dc8a3c725b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2882d4e-8691-4d0b-abf9-7fd49d8802c2", "tag": "eb486d46-6c82-4ab7-9d76-3c9b15760cbd"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:05.816962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5b9d1831-eb4a-41dc-9129-1d23519d0f99 req-068daa21-16fb-4dac-be18-69dc8a3c725b service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:05.817407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5b9d1831-eb4a-41dc-9129-1d23519d0f99 req-068daa21-16fb-4dac-be18-69dc8a3c725b service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:05.829610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-5b9d1831-eb4a-41dc-9129-1d23519d0f99 req-068daa21-16fb-4dac-be18-69dc8a3c725b service nova] Creating event network-changed:eb486d46-6c82-4ab7-9d76-3c9b15760cbd for instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 on hv-cinder-82549 Jun 06 12:10:05.835366 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-5b9d1831-eb4a-41dc-9129-1d23519d0f99 req-068daa21-16fb-4dac-be18-69dc8a3c725b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030598 Jun 06 12:10:05.837333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 317/630] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:07.140202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-353320079", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b28cd738-01fc-4c76-9f5e-f62fc40b772a"}], "security_groups": [{"name": "tempest-securitygroup--1780616802"}], "key_name": "tempest-keypair-1529759032", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:07.243143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] validate_networks() for [('b28cd738-01fc-4c76-9f5e-f62fc40b772a', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:10:07.651956 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:10:07.652381 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:10:07.652857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:10:07.653269 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:10:07.653676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:10:07.662470 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:07.662955 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:07.664325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:07.664771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:07.681394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for project e4e76a3125df4436abf5f788e35d492f. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:10:07.685281 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Getting quotas for user c8bda0c079054e198ffeca4c0ac18bf2 and project e4e76a3125df4436abf5f788e35d492f. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:10:07.696615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:10:07.698917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:10:07.743891 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [c2dda806-d869-45ff-ae1b-c41da7207734] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 06 12:10:08.752437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [c2dda806-d869-45ff-ae1b-c41da7207734] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 45304. Jun 06 12:10:08.756379 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-82861415-0be8-44e9-ad1c-a0ac1ab51d50 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.620592 Jun 06 12:10:08.757024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 314/631] 10.222.0.41 () {62 vars in 1187 bytes} [Mon Jun 6 12:10:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 12:10:08.767913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:08.768686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:08.825559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:08.832778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:08.834293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:08.836160 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-45df56ad-7a62-4e5f-b674-a1a65bd7522f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1281 microversion: 2.20 time: 0.072093 Jun 06 12:10:08.837522 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 318/632] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:08 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:09.856761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:09.858143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:09.864420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:09.864940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:09.865812 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:09.866402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:09.934229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:09.944268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:09.947778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:09.949257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-26f34820-cbe4-404a-93c9-370e13f0ec0d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1341 microversion: 2.20 time: 0.098097 Jun 06 12:10:09.950611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 315/633] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:09 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1341 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:10.006933 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:10.007466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:10.018108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.018283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:10.019544 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.020295 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:10.145992 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'services' on Instance uuid 40878e79-b477-49b5-a24b-d593f6c4531b {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:10:10.260714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-18589124-8d58-4e77-8876-9b9db73bc9e7 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments/272e0b32-e224-4eb0-860f-f7e3e6d5ffbd" status: 202 len: 0 microversion: 2.1 time: 0.257734 Jun 06 12:10:10.261388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 319/634] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:10:10 2022] DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments/272e0b32-e224-4eb0-860f-f7e3e6d5ffbd => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:10:10.269880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:10.271384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:10.278446 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.278929 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:10.279849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.280291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:10.313214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-786f7b85-c879-4dfb-9b39-37fa2ef8b454 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047354 Jun 06 12:10:10.313877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 316/635] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:10:10 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:10.968091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:10.968916 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:10.975802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.976982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:10.977759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:10.978191 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:11.120123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:11.128096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:11.129639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:11.130732 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b4a33699-f65e-497f-a742-eed9f1cb36ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.167188 Jun 06 12:10:11.131319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 320/636] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:10 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:11.325980 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:11.326956 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:11.334697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:11.335411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:11.336231 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:11.336666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:11.376500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-98f2ec57-42a8-4f11-9516-55dfde187fd3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054749 Jun 06 12:10:11.377668 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 317/637] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:10:11 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:10:11.545278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d4584742-bcf5-4c85-99f1-c7dcc03120a9 req-df7efc47-226d-4428-8244-b3235daac7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:11.555318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d4584742-bcf5-4c85-99f1-c7dcc03120a9 req-df7efc47-226d-4428-8244-b3235daac7a9 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:11.556113 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d4584742-bcf5-4c85-99f1-c7dcc03120a9 req-df7efc47-226d-4428-8244-b3235daac7a9 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:11.575217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d4584742-bcf5-4c85-99f1-c7dcc03120a9 req-df7efc47-226d-4428-8244-b3235daac7a9 service nova] Creating event network-changed:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:10:11.579699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d4584742-bcf5-4c85-99f1-c7dcc03120a9 req-df7efc47-226d-4428-8244-b3235daac7a9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038204 Jun 06 12:10:11.580293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 321/638] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:12.149622 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:12.150227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:12.156430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.156812 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.157577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.158038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.284287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:12.292771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:12.294267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:12.295401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2ecd62d9-109b-4b0d-b5ba-a7dfd39d35fa tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.149865 Jun 06 12:10:12.295960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 318/639] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:12 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:12.389384 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:12.390391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:12.396556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.397004 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.397758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.398399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.422782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:12.427333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d9727cd6-fade-4e39-8616-41731ddf1116 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042235 Jun 06 12:10:12.427882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 322/640] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:10:12 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:10:12.499625 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:12.500126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:12.506528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.507105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.507886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.508326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.532996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:10:12.607402 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f6794874-27b0-4a15-b075-f6f820aee563 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 204 len: 0 microversion: 2.1 time: 0.111330 Jun 06 12:10:12.607977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 319/641] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:10:12 2022] DELETE /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:10:12.615791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:12.616403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:12.623387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.623838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.624603 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:12.625039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:12.755275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:12.762699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1518212f-d2a1-4054-9036-3505ac1d2ce8 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.150711 Jun 06 12:10:12.763293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 323/642] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:12 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:13.314394 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:13.315124 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:13.321690 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:13.322129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:13.322902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:13.323334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:13.456027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:13.463995 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:13.465741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:13.466833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-81982d22-b37b-4159-b58b-cedfe4db37e2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.156694 Jun 06 12:10:13.467512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 320/643] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:13 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:13.779771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:13.780300 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:13.786222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:13.786665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:13.787451 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:13.787887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:13.919002 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:13.926435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-38a04801-6aad-44b3-89fa-71b953c4acd6 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.150598 Jun 06 12:10:13.927020 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 324/644] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:13 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:14.485759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:14.486492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:14.493464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:14.493920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:14.494859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:14.495375 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:14.640522 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:14.649560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:14.651103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:14.652227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a3bb8cb-7568-4e0e-9bc9-79475747b987 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.170514 Jun 06 12:10:14.652778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 321/645] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:14 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:14.943306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:14.943918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:14.950712 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:14.951196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:14.951980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:14.952416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:15.079584 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:15.087037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9e06e0cf-d0b6-4a69-b464-16b711bfd00c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.147521 Jun 06 12:10:15.087600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 325/646] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:14 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:15.669731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:15.670367 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:15.676916 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:15.677302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:15.678052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:15.678484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:15.807983 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:15.816010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:15.817596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:15.818706 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6bd2809d-59ba-40c1-b3b5-c2114b652815 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.152894 Jun 06 12:10:15.819311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 322/647] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:15 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:16.104664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:16.105304 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:16.111272 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.111717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.112480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.112909 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.247967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:16.254270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:16.254942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:16.255662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-afa603c4-d442-4837-9ff0-580afde10c8e tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.155381 Jun 06 12:10:16.256231 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 326/648] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:16 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:16.261209 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.261653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.262409 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.262856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.285363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lazy-loading 'flavor' on Instance uuid cd40cde6-b921-44c9-a864-e5d2ad7273c9 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:10:16.333449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:16.365260 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b9d85a49-4b75-4f64-8f69-5c3761706a10 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "POST /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9/action" status: 202 len: 0 microversion: 2.1 time: 0.114518 Jun 06 12:10:16.366033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 323/649] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:10:16 2022] POST /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 12:10:16.374056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:16.374684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:16.380680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.381134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.381897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.382493 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.514048 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:16.521632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-481c9102-bfe1-4593-ab5e-70228c349143 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.151472 Jun 06 12:10:16.522199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 327/650] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:16 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:16.838761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:16.839747 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:16.847416 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.848091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.848851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:16.849283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:16.980556 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:16.988443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:16.989928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:16.991038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6adeaa17-fe67-430b-92ff-bd4a2ed0743e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.157594 Jun 06 12:10:16.991590 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 324/651] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:16 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:17.272616 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:17.274098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:17.280340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:17.280777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:17.281532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:17.281965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:17.408273 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:17.416747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b769f27a-bd1a-4cd3-90cd-99f2699ffb68 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.147990 Jun 06 12:10:17.417313 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 328/652] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:17 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:17.539861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:17.540487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:17.546553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:17.547041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:17.547808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:17.548248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:17.671347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:17.679144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:17.686543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3910df32-6482-4456-a247-c90c14b8ccc4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.150746 Jun 06 12:10:17.687131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 325/653] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:17 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:18.010820 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:18.011607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:18.018157 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.018597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.019562 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.020104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.122908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-8d8c7b5d-521d-45e8-9774-8b83d4f308e5 req-4b9711f5-e11f-4864-ae1c-95f8afbf99f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "name": "network-vif-plugged", "status": "completed", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:18.146013 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=10 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:18.149731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8d8c7b5d-521d-45e8-9774-8b83d4f308e5 req-4b9711f5-e11f-4864-ae1c-95f8afbf99f8 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.149908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-8d8c7b5d-521d-45e8-9774-8b83d4f308e5 req-4b9711f5-e11f-4864-ae1c-95f8afbf99f8 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.157026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:18.166937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:18.168472 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:18.169613 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ac65020b-932f-449a-8dd2-1f1e01d34e00 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.164429 Jun 06 12:10:18.169806 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-8d8c7b5d-521d-45e8-9774-8b83d4f308e5 req-4b9711f5-e11f-4864-ae1c-95f8afbf99f8 service nova] Creating event network-vif-plugged:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:10:18.177898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 329/654] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:18 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:18.178102 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-8d8c7b5d-521d-45e8-9774-8b83d4f308e5 req-4b9711f5-e11f-4864-ae1c-95f8afbf99f8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055945 Jun 06 12:10:18.178102 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 326/655] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:18.434353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:18.435735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:18.442869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.443796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.444780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.446623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.584887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:18.593312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5309a972-6fa8-4afa-ba79-6ecda83b2dc3 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1689 microversion: 2.1 time: 0.162941 Jun 06 12:10:18.593886 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 330/656] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:18 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:18.704907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:18.705614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:18.712564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.713017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.713786 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:18.714471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:18.861161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:18.869508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf4ec3c4-d8b1-462f-aab9-0cc847111719 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.168743 Jun 06 12:10:18.870105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 327/657] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:18 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:19.189214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:19.190078 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:19.192254 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:19.200121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.200564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.201328 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.201757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.333349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:19.342333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:19.343863 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:19.344968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-29d0b44b-82f3-4e33-9ccc-c9bfd0773f47 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.160337 Jun 06 12:10:19.345520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 331/658] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:19 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:19.611215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:19.611810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:19.619523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.619978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.620745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.621182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.683551 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:19.698326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-17425378-b942-4837-926a-2c34f1301c3c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1622 microversion: 2.1 time: 0.090943 Jun 06 12:10:19.699161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 328/659] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:19 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1622 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:19.739814 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-6b4011f8-5ee6-4280-9f20-c2493e44bf70 req-340802ef-39f2-416a-b1f8-065b7d210984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40878e79-b477-49b5-a24b-d593f6c4531b", "name": "network-vif-deleted", "tag": "6746eab5-e6f9-483f-8f81-975694835a75"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:19.748651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6b4011f8-5ee6-4280-9f20-c2493e44bf70 req-340802ef-39f2-416a-b1f8-065b7d210984 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.749092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6b4011f8-5ee6-4280-9f20-c2493e44bf70 req-340802ef-39f2-416a-b1f8-065b7d210984 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.759997 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-6b4011f8-5ee6-4280-9f20-c2493e44bf70 req-340802ef-39f2-416a-b1f8-065b7d210984 service nova] Creating event network-vif-deleted:6746eab5-e6f9-483f-8f81-975694835a75 for instance 40878e79-b477-49b5-a24b-d593f6c4531b on hv-cinder-82549 Jun 06 12:10:19.765062 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-6b4011f8-5ee6-4280-9f20-c2493e44bf70 req-340802ef-39f2-416a-b1f8-065b7d210984 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028924 Jun 06 12:10:19.765657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 332/660] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:19.888312 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:19.888933 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:19.895887 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.896332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:19.897109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:19.897536 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.047144 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:20.055510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-734a79f2-8570-40a6-ba7b-ff9c5dc5709b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.171048 Jun 06 12:10:20.056060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 329/661] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:19 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:20.363953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:20.364693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:20.371241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:20.371690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.372442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:20.372883 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.508569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:20.517191 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:20.518692 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:20.519833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bc73d4e3-445d-484c-88de-8b13b7356687 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1407 microversion: 2.20 time: 0.160422 Jun 06 12:10:20.522887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 333/662] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:20 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:20.715668 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:20.716226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:20.723002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:20.723457 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.724234 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:20.724674 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.757150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:20.757606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:20.758049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'fault' on Instance uuid 40878e79-b477-49b5-a24b-d593f6c4531b {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:10:20.821574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:20.833996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d09b2799-8142-4154-b2a9-c8585a89292d tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 200 len: 1336 microversion: 2.1 time: 0.121218 Jun 06 12:10:20.834606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 330/663] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:20 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:21.072350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:21.072960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:21.079042 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.079492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.080241 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.080675 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.439593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:21.449836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-2ad9badb-fef2-4b66-b52a-ef48689ead20 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.381235 Jun 06 12:10:21.450416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 334/664] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:21 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:21.538863 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:21.539766 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:21.545944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.546398 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.547192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.547634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.676842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:21.685853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:21.687429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:21.688588 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b79655ad-5dea-42ac-875a-3794a1913edc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1599 microversion: 2.20 time: 0.154343 Jun 06 12:10:21.689204 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 331/665] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:10:21 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:10:21.706604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:21.707164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:21.713741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.714182 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.715226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.715651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.793811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4a0e7c6b-1901-4e6f-84fb-c62c5bf4a2c2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091022 Jun 06 12:10:21.794404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 335/666] 10.222.0.41 () {60 vars in 1315 bytes} [Mon Jun 6 12:10:21 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:10:21.859373 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:21.860021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 40878e79-b477-49b5-a24b-d593f6c4531b] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:21.867083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.867640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.868198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:21.868632 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:21.882687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] HTTP exception thrown: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Request method failure captured: Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b HTTP/1.1 Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0sqgscjiYsCiYUYsl0n0mA6SRjuwMz1_ipHPhe-MsEFs5zc4RSb8fbJ0H5qag0P3vEc5Sl_HC8MbYna4KYlh7hF-Yc82-WPWYh2Brs9Lv9UuVLsArj4xFZ2Qj9tQoR5sKk4xyuuVkAd2xge7Clytqv55M2JjnDhXvlRo5hHDT1EnE Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:10:21.884288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cf5de9215c3243e1b2fabc859f102b2a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 473532c21cad4c3492c8425855993b0f Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. Jun 06 12:10:21.885881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '40878e79-b477-49b5-a24b-d593f6c4531b'} Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:21.886790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. Jun 06 12:10:21.888263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:21.889570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Returning 404 to user: Instance 40878e79-b477-49b5-a24b-d593f6c4531b could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:21.889570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a5478fa7-dbef-4fae-8dbf-f515ef47f768 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b" status: 404 len: 111 microversion: 2.1 time: 0.030223 Jun 06 12:10:21.889570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 332/667] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:21 2022] GET /compute/v2.1/servers/40878e79-b477-49b5-a24b-d593f6c4531b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:10:21.895053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c91734a2-00ff-4c71-a486-bec33823c1e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '.version_select at 0x7fc1680c2550>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:21.912859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c91734a2-00ff-4c71-a486-bec33823c1e2 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263143092" status: 202 len: 0 microversion: 2.1 time: 0.021657 Jun 06 12:10:21.913668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 336/668] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 12:10:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1263143092 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:10:22.470793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:22.471641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:22.478997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:22.479683 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:22.480924 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:22.481526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:22.644085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:22.652717 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6b7794da-7efd-41f4-886d-e5ee8ae3629d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.185990 Jun 06 12:10:22.653288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 333/669] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:22 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:22.758103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-a04f4f6a-d77b-4c24-b8e3-c38db7841501 req-8730389f-d2db-4d52-b5fb-3dc7d8becb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:22.766046 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a04f4f6a-d77b-4c24-b8e3-c38db7841501 req-8730389f-d2db-4d52-b5fb-3dc7d8becb74 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:22.766484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a04f4f6a-d77b-4c24-b8e3-c38db7841501 req-8730389f-d2db-4d52-b5fb-3dc7d8becb74 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:22.777457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-a04f4f6a-d77b-4c24-b8e3-c38db7841501 req-8730389f-d2db-4d52-b5fb-3dc7d8becb74 service nova] Creating event network-changed:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:10:22.782485 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-a04f4f6a-d77b-4c24-b8e3-c38db7841501 req-8730389f-d2db-4d52-b5fb-3dc7d8becb74 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028145 Jun 06 12:10:22.783441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 337/670] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:23.670156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:23.670969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:23.678192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:23.678827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:23.680276 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:23.680935 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:23.830635 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:23.839465 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3e628855-991d-4664-ba33-bd3a54a327e3 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.172899 Jun 06 12:10:23.840057 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 334/671] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:23 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:24.842404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:24.843012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:24.849846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.850335 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:24.851956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.852406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:24.857033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:24.857650 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:24.864093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.864543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:24.865307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.865741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:24.877541 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:10:24.953777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4d3e4bf0-2a33-45e5-8516-654931f074a1 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 204 len: 0 microversion: 2.1 time: 0.115275 Jun 06 12:10:24.954439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 338/672] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:10:24 2022] DELETE /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:10:24.965643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:24.966381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:24.972710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.973271 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:24.974047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:24.974491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:25.004488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:25.013401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9bbc173b-b645-4750-91c0-a4fe50398e72 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.159972 Jun 06 12:10:25.014662 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 335/673] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:24 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:25.109754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:25.117948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e8ab8ba3-70ae-4d56-a4f6-ddc78db64208 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1509 microversion: 2.1 time: 0.158448 Jun 06 12:10:25.118515 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 339/674] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:24 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:26.031139 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:26.031748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:26.034187 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:26.041077 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:26.041523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:26.042296 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:26.042727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:26.134771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:26.136015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:26.143048 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:26.143496 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:26.144437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:26.145030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:26.165367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:26.181036 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:26.189707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-569a51fc-6981-4a30-853a-c11cb3eadb08 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.162362 Jun 06 12:10:26.190426 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 336/675] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:26 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:26.297343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:26.317843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b984bcb7-1dcc-4d33-b177-7da03fbf17ca tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 200 len: 1509 microversion: 2.1 time: 0.187204 Jun 06 12:10:26.318645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 340/676] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:26 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:26.330419 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-f4fb15cd-a75d-4aff-879d-5a1985e2692e req-20f9263e-e8d5-4dbd-a162-b74e768fc71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69e9f41-98c3-4137-9c2c-be04ba3fe88e", "name": "network-vif-deleted", "tag": "848a22bb-84ee-4d41-ab8a-001e52601be3"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:26.338825 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-f4fb15cd-a75d-4aff-879d-5a1985e2692e req-20f9263e-e8d5-4dbd-a162-b74e768fc71f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:26.339578 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-f4fb15cd-a75d-4aff-879d-5a1985e2692e req-20f9263e-e8d5-4dbd-a162-b74e768fc71f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:26.351013 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-f4fb15cd-a75d-4aff-879d-5a1985e2692e req-20f9263e-e8d5-4dbd-a162-b74e768fc71f service nova] Creating event network-vif-deleted:848a22bb-84ee-4d41-ab8a-001e52601be3 for instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e on hv-cinder-82549 Jun 06 12:10:26.355936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-f4fb15cd-a75d-4aff-879d-5a1985e2692e req-20f9263e-e8d5-4dbd-a162-b74e768fc71f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Jun 06 12:10:26.356851 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 337/677] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:27.206548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:27.207106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:27.213877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.214602 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.215389 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.215816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.337786 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:27.338490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: d69e9f41-98c3-4137-9c2c-be04ba3fe88e] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:27.344943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.346124 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.347045 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.347502 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.348119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:27.356838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-567b6932-bde7-4d6f-9e60-b1e0ab119c62 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.154116 Jun 06 12:10:27.357426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 341/678] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:27 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:27.361248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] HTTP exception thrown: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Request method failure captured: Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e HTTP/1.1 Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0sqgscjiYsCiYUYsl0n0mA6SRjuwMz1_ipHPhe-MsEFs5zc4RSb8fbJ0H5qag0P3vEc5Sl_HC8MbYna4KYlh7hF-Yc82-WPWYh2Brs9Lv9UuVLsArj4xFZ2Qj9tQoR5sKk4xyuuVkAd2xge7Clytqv55M2JjnDhXvlRo5hHDT1EnE Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:10:27.362911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cf5de9215c3243e1b2fabc859f102b2a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 473532c21cad4c3492c8425855993b0f Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. Jun 06 12:10:27.364633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'd69e9f41-98c3-4137-9c2c-be04ba3fe88e'} Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:27.365605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. Jun 06 12:10:27.367148 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:10:27.368582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Returning 404 to user: Instance d69e9f41-98c3-4137-9c2c-be04ba3fe88e could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:27.368582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c69de1c7-9ee6-46cd-bcb6-0742f3426f3a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e" status: 404 len: 111 microversion: 2.1 time: 0.032093 Jun 06 12:10:27.368582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 338/679] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:27 2022] GET /compute/v2.1/servers/d69e9f41-98c3-4137-9c2c-be04ba3fe88e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:10:27.372597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:27.373092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:27.379064 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.379512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.380266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.380700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.407545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:10:27.484118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b7db0ccb-6f24-4fe3-b300-73d5567dbbe0 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "DELETE /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 204 len: 0 microversion: 2.1 time: 0.114602 Jun 06 12:10:27.487897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 342/680] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:10:27 2022] DELETE /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:10:27.493017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:27.493652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:27.499742 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.500191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.500952 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:27.501386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:27.637836 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:27.645282 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4fe848f5-6698-4fda-b7eb-637eb2e5defb tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.156205 Jun 06 12:10:27.645840 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 339/681] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:27 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:28.374008 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:28.374702 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:28.380724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:28.381165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:28.381926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:28.382353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:28.511904 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:28.519345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-609984cd-ffb4-4eda-84d0-8fb59927d802 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.149601 Jun 06 12:10:28.519910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 343/682] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:28 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:28.664166 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:28.664778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:28.671456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:28.671902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:28.672652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:28.673083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:28.803960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:28.811400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-96718f4b-5847-4419-b47d-f87c14758380 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.151944 Jun 06 12:10:28.811958 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 340/683] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:28 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:29.536494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:29.537142 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:29.544327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:29.544825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:29.545578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:29.546006 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:29.674075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:29.682382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c38bc80a-b115-4aa8-960b-1e4da0e02ed4 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.149668 Jun 06 12:10:29.682972 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 344/684] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:29 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:29.828787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:29.829397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:29.836658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:29.837103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:29.837859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:29.838286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:29.969230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:29.977487 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b418f87c-d3f3-4f56-9fdd-7273c0f6ca9f tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.152487 Jun 06 12:10:29.978050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 341/685] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:29 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:30.700327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:30.700938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:30.707098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:30.707547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:30.708312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:30.708743 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:30.852240 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:30.860119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5d028b95-b00d-4765-a979-a5c3a8725f18 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.163508 Jun 06 12:10:30.860619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 345/686] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:30 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:30.994374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:30.995006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:31.002161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:31.002624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:31.003461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:31.003902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:31.008261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:31.140649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:31.149483 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8e467888-da23-4ba6-b78f-07e8ba27506a tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1522 microversion: 2.1 time: 0.159813 Jun 06 12:10:31.150060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 342/687] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:30 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:31.271521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-5a6c245f-bd79-446c-9f1c-b083aa167d9b req-c31f2af1-6577-420b-abe7-3307d286ccc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94392213-48bf-4710-b5da-1baad3a6c402", "name": "network-vif-deleted", "tag": "0bdc66b8-3317-4a06-9a71-2f45c001a78b"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:31.282039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5a6c245f-bd79-446c-9f1c-b083aa167d9b req-c31f2af1-6577-420b-abe7-3307d286ccc4 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:31.282589 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-5a6c245f-bd79-446c-9f1c-b083aa167d9b req-c31f2af1-6577-420b-abe7-3307d286ccc4 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:31.296037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-5a6c245f-bd79-446c-9f1c-b083aa167d9b req-c31f2af1-6577-420b-abe7-3307d286ccc4 service nova] Creating event network-vif-deleted:0bdc66b8-3317-4a06-9a71-2f45c001a78b for instance 94392213-48bf-4710-b5da-1baad3a6c402 on hv-cinder-82549 Jun 06 12:10:31.302411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-5a6c245f-bd79-446c-9f1c-b083aa167d9b req-c31f2af1-6577-420b-abe7-3307d286ccc4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Jun 06 12:10:31.303460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 346/688] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:31.877499 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:31.878109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:31.884969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:31.885420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:31.886169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:31.886600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:32.020859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:32.029392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ba7d4741-17c7-4875-b2c9-3274cd6db607 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.155792 Jun 06 12:10:32.029960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 343/689] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:31 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:32.166021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:32.166713 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:32.168662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:32.173980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:32.174416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:32.175193 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:32.175621 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:32.238561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:32.246773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1c399fd5-4cd0-4992-b1d0-233eb2112d4c tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1306 microversion: 2.1 time: 0.085044 Jun 06 12:10:32.247370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 347/690] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:32 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:33.046655 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:33.047298 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:33.054245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:33.054695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:33.055480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:33.055917 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:33.187811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:33.196025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b9d83810-2285-4577-a19e-db4431f6da1c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.153358 Jun 06 12:10:33.196592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 344/691] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:33 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:33.263705 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:33.264345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:33.270324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:33.270768 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:33.271563 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:33.271997 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:33.304789 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:33.305178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:33.305680 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lazy-loading 'fault' on Instance uuid 94392213-48bf-4710-b5da-1baad3a6c402 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:10:33.351973 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '473532c21cad4c3492c8425855993b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf5de9215c3243e1b2fabc859f102b2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:33.359870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-01dd3790-c1df-4f2f-b4d9-c422f2738ef9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 200 len: 1311 microversion: 2.1 time: 0.099938 Jun 06 12:10:33.360730 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 348/692] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:33 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:34.214816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:34.215458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:34.223265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.224380 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.225592 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.226410 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.377910 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:34.378522 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] [instance: 94392213-48bf-4710-b5da-1baad3a6c402] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:34.385277 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.385726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.386595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.387058 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.390222 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:34.398192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b68b142e-8bcc-41d4-b9cf-cd08b23c711c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1569 microversion: 2.1 time: 0.188787 Jun 06 12:10:34.399033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 345/693] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:34 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:34.405928 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] HTTP exception thrown: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Request method failure captured: Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 HTTP/1.1 Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0sqgscjiYsCiYUYsl0n0mA6SRjuwMz1_ipHPhe-MsEFs5zc4RSb8fbJ0H5qag0P3vEc5Sl_HC8MbYna4KYlh7hF-Yc82-WPWYh2Brs9Lv9UuVLsArj4xFZ2Qj9tQoR5sKk4xyuuVkAd2xge7Clytqv55M2JjnDhXvlRo5hHDT1EnE Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:10:34.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cf5de9215c3243e1b2fabc859f102b2a", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cf5de9215c3243e1b2fabc859f102b2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: cf5de9215c3243e1b2fabc859f102b2a Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1837016802 Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 473532c21cad4c3492c8425855993b0f Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1837016802-project Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. Jun 06 12:10:34.409404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '94392213-48bf-4710-b5da-1baad3a6c402'} Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:34.410190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. Jun 06 12:10:34.411399 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:34.412601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] Returning 404 to user: Instance 94392213-48bf-4710-b5da-1baad3a6c402 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:34.412601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-613a1824-d070-4cc8-8a6d-f1a2f60a01a9 tempest-ServerRescueNegativeTestJSON-1837016802 tempest-ServerRescueNegativeTestJSON-1837016802-project] 10.222.0.41 "GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402" status: 404 len: 111 microversion: 2.1 time: 0.035480 Jun 06 12:10:34.412601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 349/694] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:34 2022] GET /compute/v2.1/servers/94392213-48bf-4710-b5da-1baad3a6c402 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:10:34.416278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:34.416902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:34.423361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.423814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.424590 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.425027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.520853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8536db82-61ae-4c5d-a957-f86ae843268d tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "POST /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9/action" status: 202 len: 0 microversion: 2.1 time: 0.109500 Jun 06 12:10:34.521490 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 346/695] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:10:34 2022] POST /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 12:10:34.529575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:34.530481 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:34.537390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.537862 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.538647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:34.539110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:34.771146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:34.779607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6edf179a-cf69-4040-a684-9599a5fe64f1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1517 microversion: 2.1 time: 0.253784 Jun 06 12:10:34.780419 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 350/696] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:34 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:35.798126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:35.798595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:35.808983 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:35.809642 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:35.810411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:35.810864 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:36.172615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ae063028-2f76-4a1f-951c-b3fbfff16e8a req-a92a0be1-e15d-4f4e-838c-0eb04230a4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "name": "network-vif-unplugged", "status": "completed", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:36.187483 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ae063028-2f76-4a1f-951c-b3fbfff16e8a req-a92a0be1-e15d-4f4e-838c-0eb04230a4eb service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:36.188129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ae063028-2f76-4a1f-951c-b3fbfff16e8a req-a92a0be1-e15d-4f4e-838c-0eb04230a4eb service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:36.211790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.compute.server_external_events [req-ae063028-2f76-4a1f-951c-b3fbfff16e8a req-a92a0be1-e15d-4f4e-838c-0eb04230a4eb service nova] Unable to find a host for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9. Dropping event network-vif-unplugged {{(pid=117629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 12:10:36.212682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ae063028-2f76-4a1f-951c-b3fbfff16e8a req-a92a0be1-e15d-4f4e-838c-0eb04230a4eb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044724 Jun 06 12:10:36.213278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 351/697] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 12:10:36.307957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:36.322275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ca7ff471-5b96-4e2f-afbb-414a288ff941 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1519 microversion: 2.1 time: 0.528558 Jun 06 12:10:36.322996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 347/698] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:35 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1519 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:37.342183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:37.342800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:37.348839 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:37.349366 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:37.350941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:37.351214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:37.604924 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:37.612746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-099594b5-346f-41e1-b53d-44e53a6361e9 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.274722 Jun 06 12:10:37.613659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 352/699] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:37 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:38.632839 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:38.633579 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:38.640278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:38.640725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:38.641488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:38.641936 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:38.785131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:38.793016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c802086a-b3cb-4b60-8cd6-b161e17c7413 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.165097 Jun 06 12:10:38.793765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 348/700] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:38 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:39.354037 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8f53623d-bad3-4413-a024-fb6c39e4effc tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Action: 'create', calling method: .version_select at 0x7fc1680c23a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1905196387", "metadata": {"Type": "work"}}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:39.646575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8f53623d-bad3-4413-a024-fb6c39e4effc tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.402549 Jun 06 12:10:39.648070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 353/701] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 12:10:39 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 12:10:39.658749 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-71acfc01-82aa-41dd-9c1c-556bfd620756 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc15b7c58b0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:39.707580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-71acfc01-82aa-41dd-9c1c-556bfd620756 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 200 len: 353 microversion: 2.1 time: 0.052438 Jun 06 12:10:39.708611 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 349/702] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:10:39 2022] GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:39.809721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:39.810454 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:39.816568 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:39.817043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:39.817794 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:39.818226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:39.950756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:39.958373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7ec94eb4-6981-410c-b493-fcc95be0bfd1 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.152515 Jun 06 12:10:39.958974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 354/703] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:39 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:40.721317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-aa31deaf-2924-4d56-b53a-fa8360cb2a13 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc15b7c2dc0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:40.767384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-aa31deaf-2924-4d56-b53a-fa8360cb2a13 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 200 len: 354 microversion: 2.1 time: 0.050576 Jun 06 12:10:40.767949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 350/704] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:10:40 2022] GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:40.779285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-78f889ab-a8fa-49d8-8430-1e84434ff8f2 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc15bf5f8b0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:40.824712 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-78f889ab-a8fa-49d8-8430-1e84434ff8f2 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 200 len: 354 microversion: 2.1 time: 0.049138 Jun 06 12:10:40.825306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 355/705] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:10:40 2022] GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:40.841913 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e10b382f-75f3-49d7-94bc-19edf0ae48f7 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc15b7119d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:40.902118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e10b382f-75f3-49d7-94bc-19edf0ae48f7 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 202 len: 0 microversion: 2.1 time: 0.064154 Jun 06 12:10:40.902718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 351/706] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:10:40 2022] DELETE /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:10:40.910615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f8b8dd20-80b3-46e3-999f-05ce096a2c50 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc15bf5f1f0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:40.958311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f8b8dd20-80b3-46e3-999f-05ce096a2c50 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 200 len: 353 microversion: 2.1 time: 0.051421 Jun 06 12:10:40.958978 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 356/707] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:10:40 2022] GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:40.976677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:40.977332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:40.983481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:40.983933 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:40.984697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:40.985137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:41.116790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:41.124723 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-af3c8546-c94b-41f4-b090-ef9984101583 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.151829 Jun 06 12:10:41.125323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 352/708] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:40 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:41.971732 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-43ddda58-8c48-4fe0-8ed1-f2c97ab50f69 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Calling method '.version_select at 0x7fc1680c2280>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:41.999121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-43ddda58-8c48-4fe0-8ed1-f2c97ab50f69 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] HTTP exception thrown: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-43ddda58-8c48-4fe0-8ed1-f2c97ab50f69 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Request method failure captured: Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 HTTP/1.1 Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine6_o91VvL1vOhzngdJ7RtHUf1cTebT-MHIfyc_3JQZ5UvU1nNJ1SDiwUWn6fF2tB2tpT0lCEy1tQygbQlXcB5JzJrOIq2mNOIk9kE2IBHk99VLgx4bZNMcFcPwD4NQs29IxsoNqq7-JKO2lF12YPzScJ5zRKpJJyIrKxRMjUMX_CVc Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: d7673fc376a940ee95c9381d83a5393f Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesGetTestJSON-1412461048 Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:10:42.002913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d7673fc376a940ee95c9381d83a5393f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d7673fc376a940ee95c9381d83a5393f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d7673fc376a940ee95c9381d83a5393f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d7673fc376a940ee95c9381d83a5393f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesGetTestJSON-1412461048 Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: d7673fc376a940ee95c9381d83a5393f Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesGetTestJSON-1412461048 Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesGetTestJSON-1412461048-project Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 71686b16188c45b0baeb13493581ebd9 Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesGetTestJSON-1412461048-project Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83'} Jun 06 12:10:42.004373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. (HTTP 404) (Request-ID: req-4989858d-7db6-48b0-b329-109cdf0e6286) Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:42.005308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:10:42.007246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 12:10:42.008869 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-43ddda58-8c48-4fe0-8ed1-f2c97ab50f69 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] Returning 404 to user: Volume 633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-43ddda58-8c48-4fe0-8ed1-f2c97ab50f69 tempest-VolumesGetTestJSON-1412461048 tempest-VolumesGetTestJSON-1412461048-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83" status: 404 len: 109 microversion: 2.1 time: 0.036684 Jun 06 12:10:42.010204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 357/709] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:10:41 2022] GET /compute/v2.1/os-volumes/633ec96b-bfd3-4d61-a2a3-b8b9f3d2cd83 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:10:42.141945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:42.142586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:42.149977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:42.150424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:42.151224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:42.151661 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:42.293475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:42.302331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e2232f94-ee1f-47b8-b7d7-12a256c42196 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.164270 Jun 06 12:10:42.302931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 353/710] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:42 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:43.320697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:43.321311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:43.327368 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:43.327817 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:43.328579 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:43.329023 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:43.467511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:43.474998 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0f640c0c-84ea-4472-9c8f-02b7d4b9716c tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.158648 Jun 06 12:10:43.475661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 358/711] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:43 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:44.493309 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:44.493856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:44.500600 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:44.501050 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:44.501819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:44.502256 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:44.634261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:44.642175 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b9d77c01-44ad-4526-89c0-0c5a293e52e0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.153922 Jun 06 12:10:44.642748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 354/712] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:44 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:45.659187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:45.660033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:45.665755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:45.666196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:45.667019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:45.667450 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:45.813066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:45.821288 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7863db9a-2911-4fd4-9f15-d36e2cc4ac50 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.166088 Jun 06 12:10:45.821889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 359/713] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:45 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:45.940041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:45.940543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:45.947646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:45.948111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:45.948863 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:45.949290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:45.975408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:10:46.050228 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-22fb301b-99ad-4ecf-be8a-6896b1da4900 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "DELETE /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 204 len: 0 microversion: 2.1 time: 0.113780 Jun 06 12:10:46.050796 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 355/714] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:10:45 2022] DELETE /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:10:46.059602 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:46.060207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:46.066112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:46.066553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:46.067322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:46.067753 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:46.198885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:46.206491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6799854a-771b-47a7-a122-625a779e4bac tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1576 microversion: 2.1 time: 0.150605 Jun 06 12:10:46.207608 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 360/715] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:46 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:46.838086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:46.838928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:46.845301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:46.845937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:46.846732 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:46.847351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:46.996026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:47.005790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bcefd9e8-9582-458f-b1fd-988261afe76b tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.171815 Jun 06 12:10:47.007440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 356/716] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:46 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:47.281228 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:47.281840 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:47.288355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:47.288799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:47.289555 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:47.289985 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:47.293918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:47.442237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:47.450367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-004c4d01-093d-42dc-8f61-ad6e293be5a0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1576 microversion: 2.1 time: 0.172913 Jun 06 12:10:47.454931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 361/717] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:47 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:48.023653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:48.024351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:48.031338 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:48.031869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:48.033443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:48.033951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:48.188767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:48.198142 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-85baf1f3-e211-45a8-a599-1784cfb61e59 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.178830 Jun 06 12:10:48.199172 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 357/718] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:48 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:48.317197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-27b4ba0d-bda8-4081-b9a7-845a87f198da req-9ddae1cf-28b0-4c48-a71f-23f34eb2043a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "name": "network-vif-plugged", "status": "completed", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:48.332442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-27b4ba0d-bda8-4081-b9a7-845a87f198da req-9ddae1cf-28b0-4c48-a71f-23f34eb2043a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:48.333295 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-27b4ba0d-bda8-4081-b9a7-845a87f198da req-9ddae1cf-28b0-4c48-a71f-23f34eb2043a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:48.349264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-27b4ba0d-bda8-4081-b9a7-845a87f198da req-9ddae1cf-28b0-4c48-a71f-23f34eb2043a service nova] Creating event network-vif-plugged:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:10:48.355824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-27b4ba0d-bda8-4081-b9a7-845a87f198da req-9ddae1cf-28b0-4c48-a71f-23f34eb2043a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042704 Jun 06 12:10:48.357253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 362/719] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:48.469740 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:48.470366 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:48.477034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:48.477485 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:48.478266 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:48.478704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:48.663158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:48.679521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e2702c4f-5b14-44d4-aa80-30ca2f80f84f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1576 microversion: 2.1 time: 0.209471 Jun 06 12:10:48.680152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 358/720] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:48 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:49.218669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:49.219527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:49.226834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:49.227342 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:49.228106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:49.228545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:49.370971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:49.381149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-826fae98-a982-4479-8a6c-8356ed7f85ea tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.167118 Jun 06 12:10:49.381860 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 363/721] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:49 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:49.440194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-cc75c113-74fc-405a-89f0-bdf162903e0a req-4e3583d7-4968-4681-9a0f-05d294373470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105b21a4-46f9-4578-a9d6-7e368603efea", "name": "network-vif-deleted", "tag": "5b0256cb-e62e-4d57-9fdd-534c0db702ae"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:49.451677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-cc75c113-74fc-405a-89f0-bdf162903e0a req-4e3583d7-4968-4681-9a0f-05d294373470 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:49.452214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-cc75c113-74fc-405a-89f0-bdf162903e0a req-4e3583d7-4968-4681-9a0f-05d294373470 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:49.463258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:49.466484 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-cc75c113-74fc-405a-89f0-bdf162903e0a req-4e3583d7-4968-4681-9a0f-05d294373470 service nova] Creating event network-vif-deleted:5b0256cb-e62e-4d57-9fdd-534c0db702ae for instance 105b21a4-46f9-4578-a9d6-7e368603efea on hv-cinder-82549 Jun 06 12:10:49.471894 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-cc75c113-74fc-405a-89f0-bdf162903e0a req-4e3583d7-4968-4681-9a0f-05d294373470 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035486 Jun 06 12:10:49.472720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 359/722] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:49.698703 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:49.699937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:49.707730 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:49.708616 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:49.709439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:49.709878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:49.784309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:49.793476 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-296616a5-f89a-4098-8014-2d5abc583a5d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1509 microversion: 2.1 time: 0.100596 Jun 06 12:10:49.794047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 364/723] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:49 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1509 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:50.400573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:50.401474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:50.408831 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:50.409377 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:50.410197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:50.411226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:50.807975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:50.814737 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:50.815386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:50.826084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:50.827038 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:50.827216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6ec4a866-58ee-49f0-9637-ee1e1c69fa39 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1575 microversion: 2.1 time: 0.431328 Jun 06 12:10:50.828171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:50.828673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:50.832192 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 360/724] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:50 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1575 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:50.872799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:50.873441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:50.874028 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lazy-loading 'fault' on Instance uuid 105b21a4-46f9-4578-a9d6-7e368603efea {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:10:50.915460 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:50.924611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a21ba1cc-6b2a-4ad6-872b-2dee5f95a8b2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 200 len: 1230 microversion: 2.1 time: 0.113717 Jun 06 12:10:50.925340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 365/725] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:50 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:51.850543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:51.851197 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:51.862905 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:51.863508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:51.864951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:51.867356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:51.949488 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:51.950386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:51.957226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:51.957879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:51.958864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:51.960056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:51.975868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] HTTP exception thrown: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Request method failure captured: Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea HTTP/1.1 Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine3sJI2mhZtIasT71Qe58wfN9Wl2hfV7qna7W9pJjnw9LmhWRbFIpLtP1pmpsb5E2Tzyi6U5p_enMUJRZhPR0KC6SdfEOiyJqabxkmrokasox4nfEGZrUgcKyM4fuk0HzSJSXuTANWX4_gXZ-ToCY9B_56IFj5PYWVlJUzL1Z6U2bWE Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:10:51.977523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c80560ca253e41239020e2c008a9b3ba", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: adb92379209e46e79de4df370183fa8a Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:10:51.979224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '105b21a4-46f9-4578-a9d6-7e368603efea'} Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:10:51.980114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:10:51.981552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:10:51.983775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Returning 404 to user: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:10:51.984627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-740c6dc8-e6b2-45cd-9423-6ccc3ef48eff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 404 len: 111 microversion: 2.1 time: 0.039096 Jun 06 12:10:51.985185 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 366/726] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:51 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:10:52.024662 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:52.033293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8bb05db7-1d98-456c-96f4-2d7b01583fc0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1562 microversion: 2.1 time: 0.187246 Jun 06 12:10:52.034140 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 361/727] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:51 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1562 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:52.102225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1283966543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2130326679", "security_groups": [{"name": "tempest-secgroup-smoke-692902684"}], "block_device_mapping_v2": [{"uuid": "2ea5bf0f-3b21-4010-905c-a3c337f8385e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:52.231939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] validate_networks() for [('b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:10:52.620677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:10:52.621259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:10:52.621924 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:10:52.622433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:10:52.623013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:10:52.632030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:52.632562 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:52.633470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:52.633992 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:52.651244 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:10:52.655253 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for user adb92379209e46e79de4df370183fa8a and project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:10:52.714513 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:10:52.716631 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea5bf0f-3b21-4010-905c-a3c337f8385e',volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:10:52.866523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d17bcd9d-54bf-4b2d-b439-2ccc4d895ff7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767381 Jun 06 12:10:52.867521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 367/728] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:10:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:10:52.879313 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d0867c20-b854-45d8-bfe3-dd1b516ce55b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:52.880827 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d0867c20-b854-45d8-bfe3-dd1b516ce55b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:52.941833 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d0867c20-b854-45d8-bfe3-dd1b516ce55b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:52.953078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d0867c20-b854-45d8-bfe3-dd1b516ce55b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1095 microversion: 2.1 time: 0.078194 Jun 06 12:10:52.954017 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 362/729] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:52 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:53.970650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:53.977540 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:53.985197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:53.985691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:53.986712 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:53.987180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:54.064724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:54.073611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-af0682d3-a1c9-439b-bb89-9740a54f218d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1211 microversion: 2.1 time: 0.106773 Jun 06 12:10:54.074183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 368/730] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:53 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:55.091283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:55.091897 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:55.099389 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.099843 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.100614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.101053 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.256548 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:55.267516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fb9e31eb-832b-426b-bc3c-016ce074d463 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.180331 Jun 06 12:10:55.268105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 363/731] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:55 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:55.416358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-458ad994-125f-44a7-88ef-5990161d70ff req-bc4bdb03-c214-4b49-b3a3-d7394a05f2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705bc7b-fa65-4964-8568-aed2910f5d3f", "tag": "a37d411c-8de5-4f08-92d3-aa87b62b7883"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:55.428774 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-458ad994-125f-44a7-88ef-5990161d70ff req-bc4bdb03-c214-4b49-b3a3-d7394a05f2e2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.430382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-458ad994-125f-44a7-88ef-5990161d70ff req-bc4bdb03-c214-4b49-b3a3-d7394a05f2e2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.443507 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-458ad994-125f-44a7-88ef-5990161d70ff req-bc4bdb03-c214-4b49-b3a3-d7394a05f2e2 service nova] Creating event network-changed:a37d411c-8de5-4f08-92d3-aa87b62b7883 for instance e705bc7b-fa65-4964-8568-aed2910f5d3f on hv-cinder-82549 Jun 06 12:10:55.453348 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-458ad994-125f-44a7-88ef-5990161d70ff req-bc4bdb03-c214-4b49-b3a3-d7394a05f2e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040654 Jun 06 12:10:55.454384 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 369/732] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:55.747512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:55.748516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:55.754791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.755275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.756045 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.756477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.785030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ec6a4cda-22e5-432c-a93e-4a46685f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041406 Jun 06 12:10:55.785605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 364/733] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:10:55 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 12:10:55.844890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:55.845473 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:55.853285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.853934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.854874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.855459 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.887761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:10:55.960319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bf04ebba-2245-4d14-8ee1-f86b864448f9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 204 len: 0 microversion: 2.1 time: 0.119423 Jun 06 12:10:55.960991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 370/734] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:10:55 2022] DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:10:55.970158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:55.970771 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:55.977460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.977911 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:55.978676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:55.979145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:56.117873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:56.125549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8911d203-8271-45d4-a44c-3ed76f5ff02e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1674 microversion: 2.1 time: 0.159255 Jun 06 12:10:56.126113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 365/735] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:55 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:56.285643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:56.286339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:56.293149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:56.293595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:56.294353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:56.294786 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:56.433762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:56.441405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-324245de-0cff-48d1-9510-8fb701445baf tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.160058 Jun 06 12:10:56.442091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 371/736] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:56 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:57.144230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:57.144823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:57.147421 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:10:57.153530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:57.153988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:57.154770 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:57.155272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:57.292173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:57.299689 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-82495284-b141-4c41-a313-646ca87f7c4d tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1674 microversion: 2.1 time: 0.159441 Jun 06 12:10:57.300252 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 366/737] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:57 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:57.459105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:57.459623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:57.466158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:57.466604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:57.467573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:57.468009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:57.603734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:57.611264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fbab339f-1c08-456a-ab16-658fd0aa1ee6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.156168 Jun 06 12:10:57.611829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 372/738] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:57 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:10:58.317785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:58.318417 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:58.325633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:58.326101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:58.326869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:58.327308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:58.470724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:58.480369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a02e8e57-84e6-4d88-8e49-ad8e66aae4d9 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1674 microversion: 2.1 time: 0.166293 Jun 06 12:10:58.482879 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 367/739] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:58 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:58.628220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:58.628846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:58.635766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:58.636286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:58.637144 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:58.637646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:58.779099 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:58.787323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd2799f3-0b13-4fa3-be14-5245c9c940ff tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.163095 Jun 06 12:10:58.787900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 373/740] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:58 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:59.498180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:59.498951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:59.506044 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:59.508752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:59.509643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:59.510087 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:59.578090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:59.595426 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c76b22b-777d-4715-93b9-948b5d6c9478 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 200 len: 1606 microversion: 2.1 time: 0.101336 Jun 06 12:10:59.596245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 368/741] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:59 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 1606 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:10:59.599979 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d3064873-8d8d-4e16-af4b-f6b47700c37e req-81b0b980-9fe6-41ab-9fd4-167a59d105b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ad39f5-7b1d-4a44-b425-4742770b160a", "name": "network-vif-deleted", "tag": "872b9233-6f23-4c37-93d6-900a553354e5"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:10:59.609059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d3064873-8d8d-4e16-af4b-f6b47700c37e req-81b0b980-9fe6-41ab-9fd4-167a59d105b2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:59.609549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d3064873-8d8d-4e16-af4b-f6b47700c37e req-81b0b980-9fe6-41ab-9fd4-167a59d105b2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:59.623699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d3064873-8d8d-4e16-af4b-f6b47700c37e req-81b0b980-9fe6-41ab-9fd4-167a59d105b2 service nova] Creating event network-vif-deleted:872b9233-6f23-4c37-93d6-900a553354e5 for instance 75ad39f5-7b1d-4a44-b425-4742770b160a on hv-cinder-82549 Jun 06 12:10:59.628491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d3064873-8d8d-4e16-af4b-f6b47700c37e req-81b0b980-9fe6-41ab-9fd4-167a59d105b2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Jun 06 12:10:59.629711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 374/742] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:10:59.806218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:10:59.807097 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:10:59.818740 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:59.819231 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:59.820576 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:10:59.821035 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:10:59.960744 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:10:59.969545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-dfa895f9-9d63-4eca-abd6-ac9fc92642b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.167945 Jun 06 12:10:59.970226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 369/743] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:10:59 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:00.612767 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:00.613461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:00.619922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:00.620370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:00.621140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:00.621596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:00.636607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a HTTP/1.1 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:11:00.639086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:11:00.640659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '75ad39f5-7b1d-4a44-b425-4742770b160a'} Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:11:00.641595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:11:00.642974 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:11:00.644073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:11:00.644073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6414087d-83aa-4713-a819-78c7eb27addd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 404 len: 111 microversion: 2.1 time: 0.032005 Jun 06 12:11:00.644073 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 375/744] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:00 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:11:00.650161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d812fccd-5dac-4e54-b1bd-d49e02bccc8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '.version_select at 0x7fc15b6c31f0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:00.669239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d812fccd-5dac-4e54-b1bd-d49e02bccc8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-680661297" status: 202 len: 0 microversion: 2.1 time: 0.023462 Jun 06 12:11:00.669846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 370/745] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 12:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-680661297 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:11:00.985854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:00.986464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:00.992710 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:00.993155 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:00.993920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:00.994354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:01.205569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:01.214885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a9f2af7a-eea3-400a-8d76-2a0d87a7cd4b tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.232873 Jun 06 12:11:01.216131 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 376/746] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:00 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:01.402216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a96eada3-7d7d-41c2-bca9-37d3cb39834f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: .version_select at 0x7fc15b7ed820>, body: {"keypair": {"name": "tempest-keypair-1634701409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKg68LdBECLkg51tNcISRRQ/2m4i6CEDjR/fA7u6XfW+GyUUlfnZvqgBwoXlwnQHaJAiJgsD/Xi21mIPBtO5N/fcxkwotWhObnOz4XlQKeQuwG9Z3mYpLBUiXbGF+Fcgg=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:01.420495 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-a96eada3-7d7d-41c2-bca9-37d3cb39834f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for project ffaf09bc77914692bb965b55af538141. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:11:01.424431 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-a96eada3-7d7d-41c2-bca9-37d3cb39834f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for user 6c904a413f6a4ba49686debac817c70d and project ffaf09bc77914692bb965b55af538141. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:11:01.447237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a96eada3-7d7d-41c2-bca9-37d3cb39834f tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049256 Jun 06 12:11:01.447845 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 371/747] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:11:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:02.233019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:02.233839 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:02.235868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:02.241441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:02.242077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:02.242864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:02.243350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:02.482080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:02.494604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e74c682e-f852-4b68-bb3e-258f3a5c3a4e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.265548 Jun 06 12:11:02.495306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 377/748] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:02 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:11:02.886007 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-160752408", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43ca690c-a1bc-4f83-bc21-4d7b4fd16d4d"}], "security_groups": [{"name": "tempest-securitygroup--762996236"}], "key_name": "tempest-keypair-1634701409", "user_data": "}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:02.992924 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] validate_networks() for [('43ca690c-a1bc-4f83-bc21-4d7b4fd16d4d', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:11:03.375545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:11:03.375994 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:11:03.376468 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:11:03.376882 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:11:03.377293 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:11:03.386606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:03.387096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:03.387915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:03.388356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:03.406095 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for project ffaf09bc77914692bb965b55af538141. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:11:03.410301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Getting quotas for user 6c904a413f6a4ba49686debac817c70d and project ffaf09bc77914692bb965b55af538141. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:11:03.422661 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:11:03.425239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:11:03.474585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6d099aa0-600b-4295-a172-de2eb710b66b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593397 Jun 06 12:11:03.475181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 372/749] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:11:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:11:03.485760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03a671c6-1044-40bf-b63d-7b7eff63adc2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:03.486376 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03a671c6-1044-40bf-b63d-7b7eff63adc2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:03.488229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:03.488881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:03.511427 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:03.512306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:03.518784 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:03.519339 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:03.520288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:03.520726 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:03.552986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03a671c6-1044-40bf-b63d-7b7eff63adc2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:03.564187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03a671c6-1044-40bf-b63d-7b7eff63adc2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1237 microversion: 2.1 time: 0.082205 Jun 06 12:11:03.565107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 378/750] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:03 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:03.660036 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:03.668634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ff0d2a78-f046-4532-b595-9904331e5699 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.161081 Jun 06 12:11:03.669210 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 373/751] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:03 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:11:04.581642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:04.582383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:04.589143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:04.589780 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:04.590658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:04.591120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:04.655717 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:04.663521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8ec99015-582c-42f3-9942-058b80e70848 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1289 microversion: 2.1 time: 0.085865 Jun 06 12:11:04.664870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 379/752] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:04 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:04.685283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:04.685904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:04.692552 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:04.693006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:04.693773 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:04.694213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:04.824931 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:04.832330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7720e9f0-bb3a-4adb-a20b-edd324e17972 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.150815 Jun 06 12:11:04.832854 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 374/753] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:04 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:05.682159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:05.682764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:05.688740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:05.689184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:05.689943 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:05.690383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:05.754675 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:05.758165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:05.763092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-59c53e37-a04f-462a-8de8-d9dd487d48dd tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1295 microversion: 2.1 time: 0.085605 Jun 06 12:11:05.763669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 380/754] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:05 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:05.850946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:05.852981 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:05.859326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:05.860526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:05.860526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:05.860954 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:06.001919 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:06.010123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0f2e578c-43f0-4d69-9155-15db9658f5ce tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.163850 Jun 06 12:11:06.010695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 375/755] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:05 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:06.695149 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-f3875e7e-4ef6-4f86-b909-655b6fb130eb req-b8ac0818-37e3-4d7e-8869-b9f80a3309dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fca81c-28df-4c59-8a0f-73f0ca291fb3", "tag": "f1faca20-5372-4608-9976-7e6da17ee460"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:06.705998 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-f3875e7e-4ef6-4f86-b909-655b6fb130eb req-b8ac0818-37e3-4d7e-8869-b9f80a3309dc service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:06.706586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-f3875e7e-4ef6-4f86-b909-655b6fb130eb req-b8ac0818-37e3-4d7e-8869-b9f80a3309dc service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:06.730292 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-f3875e7e-4ef6-4f86-b909-655b6fb130eb req-b8ac0818-37e3-4d7e-8869-b9f80a3309dc service nova] Creating event network-changed:f1faca20-5372-4608-9976-7e6da17ee460 for instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 on hv-cinder-82549 Jun 06 12:11:06.735464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-f3875e7e-4ef6-4f86-b909-655b6fb130eb req-b8ac0818-37e3-4d7e-8869-b9f80a3309dc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044395 Jun 06 12:11:06.736339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 381/756] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:06.781225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:06.782006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:06.788450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:06.789731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:06.790810 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:06.791466 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:06.937643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:06.947237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-46de3b81-7788-4d68-96b6-ec4ae1cb5673 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.170603 Jun 06 12:11:06.947927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 376/757] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:06 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:07.028007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:07.029358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:07.048536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:07.049772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:07.050872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:07.051526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:07.195571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:07.203232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c58d7011-6dfd-40e7-b302-f82a8b85b967 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.180006 Jun 06 12:11:07.203798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 382/758] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:07 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:07.965953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:07.966585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:07.973086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:07.973526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:07.974279 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:07.974713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:08.105977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:08.113409 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-155ca053-af76-4757-af2f-2c3ea1e09b49 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.152790 Jun 06 12:11:08.113974 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 377/759] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:07 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:08.221033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:08.221582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:08.227844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:08.228294 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:08.229053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:08.229487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:08.364739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:08.372735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8bc5c01f-5691-4e80-b53a-743881d73893 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.155584 Jun 06 12:11:08.373298 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 383/760] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:08 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:09.086332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-5876bdd7-11d6-40ca-aadd-88b7c037ac42 req-288011bd-fb13-43ea-96ae-3e8cd586013e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e705bc7b-fa65-4964-8568-aed2910f5d3f", "name": "network-vif-plugged", "status": "completed", "tag": "a37d411c-8de5-4f08-92d3-aa87b62b7883"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:09.095464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5876bdd7-11d6-40ca-aadd-88b7c037ac42 req-288011bd-fb13-43ea-96ae-3e8cd586013e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:09.095923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5876bdd7-11d6-40ca-aadd-88b7c037ac42 req-288011bd-fb13-43ea-96ae-3e8cd586013e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:09.107906 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-5876bdd7-11d6-40ca-aadd-88b7c037ac42 req-288011bd-fb13-43ea-96ae-3e8cd586013e service nova] Creating event network-vif-plugged:a37d411c-8de5-4f08-92d3-aa87b62b7883 for instance e705bc7b-fa65-4964-8568-aed2910f5d3f on hv-cinder-82549 Jun 06 12:11:09.112866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-5876bdd7-11d6-40ca-aadd-88b7c037ac42 req-288011bd-fb13-43ea-96ae-3e8cd586013e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030776 Jun 06 12:11:09.113457 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 378/761] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:09.130521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:09.131171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:09.137514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:09.137968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:09.138771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:09.139224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:09.292102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:09.299514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-67d94330-fa71-46f4-9057-531b55d4303a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.172831 Jun 06 12:11:09.300068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 384/762] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:09 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:09.389999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:09.390702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:09.396918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:09.397367 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:09.398757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:09.399215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:09.536581 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:09.544900 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b155e2dd-42b0-4a8f-92b7-8a4a0a80c55f tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.159055 Jun 06 12:11:09.545544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 379/763] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:09 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:10.316306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:10.316915 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:10.323338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:10.323786 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:10.324542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:10.324980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:10.452982 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:10.460778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-72ab436c-05ce-4b4f-828f-6aeee08a8018 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.147784 Jun 06 12:11:10.461520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 385/764] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:10 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:10.561151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:10.561790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:10.568275 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:10.568658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:10.569418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:10.569874 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:10.704538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:10.708027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=100 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:10.713878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-eb423135-11ae-4ab7-9f8f-19d092025bc6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.156513 Jun 06 12:11:10.714712 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 380/765] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:10 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:11.478447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:11.479082 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:11.485117 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:11.485556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:11.486302 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:11.486733 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:11.614406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:11.622695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7ecee118-0dff-4912-a538-0a5fe4b16ea2 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.148674 Jun 06 12:11:11.623292 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 386/766] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:11 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:11.730938 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:11.731497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:11.738054 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:11.738507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:11.739304 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:11.739747 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:11.870166 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:11.877675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c6949d7b-1837-4efc-87d3-675871e05e52 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.150712 Jun 06 12:11:11.878250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 381/767] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:11 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:11:12.639539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:12.640150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:12.646234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:12.646678 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:12.647467 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:12.648781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:12.785051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:12.793226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d38e2310-8e02-43fa-b498-2e26153f0a91 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.157530 Jun 06 12:11:12.793789 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 387/768] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:12 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:12.894718 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:12.895300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:12.902228 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:12.902674 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:12.903478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:12.903914 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:13.037386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:13.045277 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c07c9c13-90f9-4514-964c-28e335250ec1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.154403 Jun 06 12:11:13.045856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 382/769] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:12 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:13.810295 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:13.810986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:13.813076 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:13.818531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:13.819014 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:13.819791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:13.820229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:13.954031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:13.961509 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7791fd9b-8010-483a-8f2e-540dbb3c8f9c tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.155051 Jun 06 12:11:13.962079 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 388/770] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:13 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:14.061548 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:14.062201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:14.064127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:14.064778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=12 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:14.071477 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:14.071923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:14.072686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:14.073126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:14.203205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:14.211118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-50d45035-25b0-48c4-aac5-bd0d05796b37 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1266 microversion: 2.1 time: 0.153405 Jun 06 12:11:14.211682 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 383/771] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:14 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:14.978580 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:14.979255 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:14.985315 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:14.985760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:14.986521 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:14.986990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.120192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:15.127537 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a2e049a4-2e4e-4833-b1ef-d08a020ab698 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.152833 Jun 06 12:11:15.128107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 389/772] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:14 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:15.228497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:15.229201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:15.235719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:15.236154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.237529 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:15.238007 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.327232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-48d1deb1-ff77-4390-bea0-b57dbb07134b req-4b7fd936-76e1-4d6e-b0cf-5aa38bb76592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fca81c-28df-4c59-8a0f-73f0ca291fb3", "name": "network-vif-plugged", "status": "completed", "tag": "f1faca20-5372-4608-9976-7e6da17ee460"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:15.335657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-48d1deb1-ff77-4390-bea0-b57dbb07134b req-4b7fd936-76e1-4d6e-b0cf-5aa38bb76592 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:15.336389 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-48d1deb1-ff77-4390-bea0-b57dbb07134b req-4b7fd936-76e1-4d6e-b0cf-5aa38bb76592 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.348455 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-48d1deb1-ff77-4390-bea0-b57dbb07134b req-4b7fd936-76e1-4d6e-b0cf-5aa38bb76592 service nova] Creating event network-vif-plugged:f1faca20-5372-4608-9976-7e6da17ee460 for instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 on hv-cinder-82549 Jun 06 12:11:15.354275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-48d1deb1-ff77-4390-bea0-b57dbb07134b req-4b7fd936-76e1-4d6e-b0cf-5aa38bb76592 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031346 Jun 06 12:11:15.355020 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 390/773] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:11:15.377950 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:15.385884 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ba78b306-2cba-45cb-adad-67a17057bb48 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1452 microversion: 2.1 time: 0.161785 Jun 06 12:11:15.386461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 384/774] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:15 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:15.403679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:15.404647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:15.412199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:15.414196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.415657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:15.416170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:15.557101 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:15.564580 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d7568082-3070-4cdf-8c2e-fff122b23767 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1452 microversion: 2.1 time: 0.166256 Jun 06 12:11:15.565282 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 391/775] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:15 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:16.145429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:16.145943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:16.153163 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:16.153631 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:16.154401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:16.154832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:16.620182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:16.627628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-82b1cefa-4f74-41a9-9639-5e37017195fc tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.486220 Jun 06 12:11:16.628201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 385/776] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:16 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:17.459320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-a9de0b52-a15c-44e2-9df3-35bba50e94c8 req-378261d7-80b9-4d7b-915f-c1f4eba3360f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705bc7b-fa65-4964-8568-aed2910f5d3f", "tag": "a37d411c-8de5-4f08-92d3-aa87b62b7883"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:17.467765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a9de0b52-a15c-44e2-9df3-35bba50e94c8 req-378261d7-80b9-4d7b-915f-c1f4eba3360f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:17.468208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-a9de0b52-a15c-44e2-9df3-35bba50e94c8 req-378261d7-80b9-4d7b-915f-c1f4eba3360f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:17.479980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-a9de0b52-a15c-44e2-9df3-35bba50e94c8 req-378261d7-80b9-4d7b-915f-c1f4eba3360f service nova] Creating event network-changed:a37d411c-8de5-4f08-92d3-aa87b62b7883 for instance e705bc7b-fa65-4964-8568-aed2910f5d3f on hv-cinder-82549 Jun 06 12:11:17.485055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-a9de0b52-a15c-44e2-9df3-35bba50e94c8 req-378261d7-80b9-4d7b-915f-c1f4eba3360f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029521 Jun 06 12:11:17.485596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 392/777] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:17.644937 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:17.645553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:17.652979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:17.653426 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:17.654182 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:17.654612 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:17.785557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:17.793544 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6379e75b-f284-42d8-b60b-892242accb52 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1362 microversion: 2.1 time: 0.152564 Jun 06 12:11:17.794115 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 386/778] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:17 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:18.811283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:18.811987 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:18.818224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:18.818667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:18.819452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:18.820610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:18.953514 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:11:18.961079 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3de5e82d-2a03-446d-98ae-54adcc896082 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1548 microversion: 2.1 time: 0.154082 Jun 06 12:11:18.961640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 393/779] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:11:18 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:11:18.978268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:18.978813 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:18.985265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:18.985721 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:18.986492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:18.986966 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:19.063765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3168c4a9-a185-4e3b-a808-f77dc4154063 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089918 Jun 06 12:11:19.064412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 387/780] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:11:18 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:19.972396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-3bb1f98f-9b24-441c-b40e-85bf72c89aee req-08624ab2-c72f-4499-a9cc-88f0d803ad81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07fca81c-28df-4c59-8a0f-73f0ca291fb3", "tag": "f1faca20-5372-4608-9976-7e6da17ee460"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:19.980711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3bb1f98f-9b24-441c-b40e-85bf72c89aee req-08624ab2-c72f-4499-a9cc-88f0d803ad81 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:19.981238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-3bb1f98f-9b24-441c-b40e-85bf72c89aee req-08624ab2-c72f-4499-a9cc-88f0d803ad81 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:19.992178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-3bb1f98f-9b24-441c-b40e-85bf72c89aee req-08624ab2-c72f-4499-a9cc-88f0d803ad81 service nova] Creating event network-changed:f1faca20-5372-4608-9976-7e6da17ee460 for instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 on hv-cinder-82549 Jun 06 12:11:19.997150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-3bb1f98f-9b24-441c-b40e-85bf72c89aee req-08624ab2-c72f-4499-a9cc-88f0d803ad81 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028369 Jun 06 12:11:19.997984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 394/781] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:45.957789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:45.958686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=40 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:45.962934 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:45.963437 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:45.971788 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:45.972232 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:45.973000 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:45.973444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:45.999330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b7aed8e5-4f50-4c47-be8b-c52406f9b61f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/ips" status: 200 len: 148 microversion: 2.1 time: 0.042996 Jun 06 12:11:45.999915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 388/782] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:11:45 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:47.342125 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135a0cad-d94c-47ed-9937-f5655e076442"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:47.343314 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:47.345471 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=37 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:47.346264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=68 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:47.352274 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:47.352756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:47.353550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:47.353983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:47.651500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bbbf746d-e71c-4415-bc7a-3f4378d6e60e tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313629 Jun 06 12:11:47.652307 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 395/783] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:11:47 2022] POST /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:11:59.357758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135a0cad-d94c-47ed-9937-f5655e076442"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:11:59.358862 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:59.361294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:59.361957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:59.367356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.367803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.368566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.369000 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.446880 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: POST /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments HTTP/1.1 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 74 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:11:59.448599 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {"volumeAttachment": {"volumeId": "135a0cad-d94c-47ed-9937-f5655e076442"}} Jun 06 12:11:59.450265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'server_id': 'f2882d4e-8691-4d0b-abf9-7fd49d8802c2', 'body': {'volumeAttachment': {'volumeId': '135a0cad-d94c-47ed-9937-f5655e076442'}}} Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:11:59.451787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:11:59.453311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 400 to user: Invalid volume: volume 135a0cad-d94c-47ed-9937-f5655e076442 is already attached to instances: f2882d4e-8691-4d0b-abf9-7fd49d8802c2 {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8220920e-5a7c-429e-85a6-b3f6307d73bf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096892 Jun 06 12:11:59.454814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 389/784] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:11:59 2022] POST /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:11:59.507764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:59.508560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:11:59.514210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:59.514791 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:59.522799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.523266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.524015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.524441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.604695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lazy-loading 'services' on Instance uuid f2882d4e-8691-4d0b-abf9-7fd49d8802c2 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:11:59.681475 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1a4b682c-0c78-44c6-904e-1b6331d92323 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments/135a0cad-d94c-47ed-9937-f5655e076442" status: 202 len: 0 microversion: 2.1 time: 0.175066 Jun 06 12:11:59.682098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 396/785] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:11:59 2022] DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments/135a0cad-d94c-47ed-9937-f5655e076442 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:11:59.690617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:11:59.691656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:11:59.698508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.698965 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.699821 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:11:59.700294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:11:59.730535 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b6c75d9f-43b8-4b89-8dbb-e749e2967b50 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 Jun 06 12:11:59.731129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 390/786] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:11:59 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:00.744099 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:00.745152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:00.752203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:00.752648 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:00.753401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:00.753832 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:00.784921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-493c5e91-403e-4e9a-9125-6cc4e350c097 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Jun 06 12:12:00.785472 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 397/787] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:12:00 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:01.796530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:01.797474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:01.803903 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:01.804350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:01.805105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:01.805533 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:01.834407 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fde0ec26-7b70-4dab-a4b7-cf4fb32c18ac tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041974 Jun 06 12:12:01.834967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 391/788] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:12:01 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:02.846652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:02.847596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:02.854658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:02.855476 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:02.856523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:02.856863 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:02.889361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c6c3f910-c3e4-4e6c-a98f-bbfd9ecbdb9f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Jun 06 12:12:02.889935 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 398/789] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:12:02 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:03.900750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:03.901688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:03.907949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:03.908401 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:03.909164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:03.909602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:03.939750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-095b0b38-a89f-4ad0-bd11-78e35a163c58 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jun 06 12:12:03.940610 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 392/790] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:12:03 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:04.950387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:04.951524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:04.957993 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:04.958445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:04.959238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:04.959676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:04.989119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4ad719f9-1b94-4eb0-96ce-b9f4eb9ae0f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042664 Jun 06 12:12:04.989673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 399/791] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:12:04 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:12:05.050155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:05.050653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:05.057121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:05.057571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:05.058319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:05.058751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:05.083714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:12:05.160189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ee254712-0325-4f06-ae4d-eb8c033d47b8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 204 len: 0 microversion: 2.1 time: 0.113312 Jun 06 12:12:05.161219 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 393/792] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:12:05 2022] DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:12:05.169236 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:05.170090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:05.176131 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:05.176569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:05.177311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:05.177740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:05.309866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:05.318196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1f5a74b4-3838-42af-96d0-8e187844ce88 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1680 microversion: 2.1 time: 0.152820 Jun 06 12:12:05.318759 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 400/793] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:05 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:06.335899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:06.336608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:06.344125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:06.344584 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:06.345353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:06.345797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:06.481655 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:06.491432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e9511d9d-aa14-4658-9812-7211646a2bdf tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1680 microversion: 2.1 time: 0.159743 Jun 06 12:12:06.492011 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 394/794] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:06 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:07.509322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:07.509926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:07.517471 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:07.517926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:07.518669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:07.519126 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:07.657561 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:07.667091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-19521011-be87-4a94-90da-48cfd87fc12a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1680 microversion: 2.1 time: 0.161448 Jun 06 12:12:07.678619 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 401/795] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:07 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:08.316027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-cfbb5ad8-9a71-471d-8747-41832a0fc5d5 req-37dba735-54dc-417c-b3f5-dddffbe06e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2882d4e-8691-4d0b-abf9-7fd49d8802c2", "name": "network-vif-deleted", "tag": "eb486d46-6c82-4ab7-9d76-3c9b15760cbd"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:08.325064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-cfbb5ad8-9a71-471d-8747-41832a0fc5d5 req-37dba735-54dc-417c-b3f5-dddffbe06e8e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:08.325586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-cfbb5ad8-9a71-471d-8747-41832a0fc5d5 req-37dba735-54dc-417c-b3f5-dddffbe06e8e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:08.343368 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-cfbb5ad8-9a71-471d-8747-41832a0fc5d5 req-37dba735-54dc-417c-b3f5-dddffbe06e8e service nova] Creating event network-vif-deleted:eb486d46-6c82-4ab7-9d76-3c9b15760cbd for instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 on hv-cinder-82549 Jun 06 12:12:08.348773 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-cfbb5ad8-9a71-471d-8747-41832a0fc5d5 req-37dba735-54dc-417c-b3f5-dddffbe06e8e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036611 Jun 06 12:12:08.349719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 395/796] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:08.684137 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:08.684778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:08.691411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:08.691848 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:08.692599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:08.693025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:08.724321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:08.724765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:08.725210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lazy-loading 'fault' on Instance uuid f2882d4e-8691-4d0b-abf9-7fd49d8802c2 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:12:08.773749 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:08.782585 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a49afd18-3a01-4497-a342-b4c424e3291a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 200 len: 1332 microversion: 2.1 time: 0.102099 Jun 06 12:12:08.783476 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 402/797] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:08 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:09.801923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:09.802643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:09.809445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:09.809902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:09.811406 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:09.812289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:09.826107 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 HTTP/1.1 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:12:09.828267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:12:09.829892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'f2882d4e-8691-4d0b-abf9-7fd49d8802c2'} Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:12:09.830793 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:12:09.832329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:12:09.833876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:12:09.833876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-43d61b75-5569-4c1c-a880-3d12223d04cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 404 len: 111 microversion: 2.1 time: 0.032695 Jun 06 12:12:09.833876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 396/798] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:09 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:12:09.838466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9b970a35-f9c2-418b-885e-4653c982b051 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '.version_select at 0x7fc15bea1940>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:09.856830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9b970a35-f9c2-418b-885e-4653c982b051 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171119986" status: 202 len: 0 microversion: 2.1 time: 0.022132 Jun 06 12:12:09.857905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 403/799] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 12:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171119986 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:12:10.500859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e070a5f9-863e-4cd7-88f6-b92278fa2423 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: .version_select at 0x7fc168146430>, body: {"keypair": {"name": "tempest-keypair-256483586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrmKSTjMrtqenj15dFvMqGYHMfQonhz57po1Ng+RUsIZO+RGXrkBQUaLMv+R9d65PTE8NfKun5oxWJdozFu7jNEEbxhh8MzBDwqk90H/yANR05+pa+ZXzAWDvZMkkah3g=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:10.515215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e070a5f9-863e-4cd7-88f6-b92278fa2423 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:12:10.519083 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-e070a5f9-863e-4cd7-88f6-b92278fa2423 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:12:10.540514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e070a5f9-863e-4cd7-88f6-b92278fa2423 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044032 Jun 06 12:12:10.541106 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 397/800] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:12:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:12.066626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-552507314", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7652b7b-d4f4-4b94-9492-ad0df97f85c2"}], "security_groups": [{"name": "tempest-securitygroup--441191840"}], "key_name": "tempest-keypair-256483586", "user_data": "}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:12.170427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] validate_networks() for [('f7652b7b-d4f4-4b94-9492-ad0df97f85c2', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:12:12.531456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:12:12.531903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:12:12.532373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:12:12.532804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:12:12.533215 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:12:12.542209 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:12.542655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:12.543517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:12.543955 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:12.561188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:12:12.565226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Getting quotas for user 6aebb057a324492699141a878793c097 and project b7d38f1b5a8a43ea8677f3ce053347da. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:12:12.576010 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:12:12.578978 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:12:12.624477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-186b1d4a-9dd6-4ddb-8a81-6697fb453428 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.562575 Jun 06 12:12:12.625123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 404/801] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:12:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:12:12.635853 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d5075481-a2df-4238-9187-08d16fe95eef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:12.636476 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d5075481-a2df-4238-9187-08d16fe95eef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:12.696665 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d5075481-a2df-4238-9187-08d16fe95eef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:12.705618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d5075481-a2df-4238-9187-08d16fe95eef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1240 microversion: 2.1 time: 0.074332 Jun 06 12:12:12.706186 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 398/802] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:12 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:13.723935 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:13.724539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:13.730983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:13.731434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:13.733035 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:13.733529 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:13.811498 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:13.819960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6881ef56-1376-4e4a-b089-aec6763661e7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1310 microversion: 2.1 time: 0.100708 Jun 06 12:12:13.829781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 405/803] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:13 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1310 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:14.837202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:14.837815 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:14.844558 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:14.845006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:14.845777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:14.846213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:14.986489 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:14.996386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d4efd2ed-0d97-4d66-bb8f-d478c6d7d8de tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.162949 Jun 06 12:12:14.997286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 399/804] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:14 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:15.180726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-206dde62-67ad-4362-92ad-501d27df98c0 req-4dd6b097-2dc5-449c-88ee-3ea18023049b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c3c40c-4b64-469a-b62f-0ce6159522fc", "tag": "5f5f0542-4e21-4640-836a-cff2c187ebcf"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:15.191756 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-206dde62-67ad-4362-92ad-501d27df98c0 req-4dd6b097-2dc5-449c-88ee-3ea18023049b service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:15.192208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-206dde62-67ad-4362-92ad-501d27df98c0 req-4dd6b097-2dc5-449c-88ee-3ea18023049b service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:15.206100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-206dde62-67ad-4362-92ad-501d27df98c0 req-4dd6b097-2dc5-449c-88ee-3ea18023049b service nova] Creating event network-changed:5f5f0542-4e21-4640-836a-cff2c187ebcf for instance 76c3c40c-4b64-469a-b62f-0ce6159522fc on hv-cinder-82549 Jun 06 12:12:15.210999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-206dde62-67ad-4362-92ad-501d27df98c0 req-4dd6b097-2dc5-449c-88ee-3ea18023049b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033846 Jun 06 12:12:15.211782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 406/805] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:16.013501 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:16.014142 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:16.020995 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:16.021446 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:16.022212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:16.022656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:16.153858 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:16.162267 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-31fdc6c7-dabf-4a18-b1f1-753da8a23523 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.152646 Jun 06 12:12:16.162864 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 400/806] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:16 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:16.454489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:16.455104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:16.461588 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:16.462038 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:16.462804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:16.463272 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:16.487820 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-76d057a5-c09c-483f-bc05-a4d00d2b0a0e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/ips" status: 200 len: 152 microversion: 2.20 time: 0.038224 Jun 06 12:12:16.488405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 407/807] 10.222.0.41 () {60 vars in 1288 bytes} [Mon Jun 6 12:12:16 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:12:17.179635 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:17.180251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:17.187344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:17.187797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:17.188559 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:17.188992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:17.316578 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:17.323861 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e7f37c4d-96ad-4bf3-9c34-cfa770ba49a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.148079 Jun 06 12:12:17.324425 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 401/808] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:17 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:18.340204 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:18.341118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:18.348135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:18.348591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:18.349363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:18.349804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:18.481308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:18.489511 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4fec9ff4-e8e2-4ebb-b11c-d9e6658568f6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.153203 Jun 06 12:12:18.490081 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 408/809] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:18 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:18.709152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:18.709675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:18.716248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:18.717271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:18.718096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:18.718528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:18.740960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lazy-loading 'flavor' on Instance uuid 12b16ad2-de00-48c9-8ebc-92cb9e533fec {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:12:18.996452 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-048e43c2-e04f-46ed-892a-274cf8e6513e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/action" status: 202 len: 0 microversion: 2.20 time: 0.291079 Jun 06 12:12:18.997103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 402/810] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 12:12:18 2022] POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:12:19.005718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:19.006330 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:19.012472 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:19.012908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:19.014180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:19.014633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:19.147024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:19.154939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:19.156441 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:19.157600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-45a00300-a1c2-4ccb-a857-18d3c10b8bc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.155811 Jun 06 12:12:19.158166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 409/811] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:19 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:19.507230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:19.507927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:19.514800 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:19.515397 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:19.516169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:19.516604 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:19.649203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:19.657126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8fc12d5a-8a9c-48bb-8b07-d115b0ca6fd2 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.154144 Jun 06 12:12:19.657692 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 403/812] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:19 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:20.176895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:20.177502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:20.183805 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:20.184250 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:20.185000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:20.185533 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:20.315469 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:20.323162 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:20.324646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:20.325787 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-da429f22-32ca-486a-b82e-13a60be71097 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.152787 Jun 06 12:12:20.326995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 410/813] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:20 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:20.673606 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:20.674353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:20.681112 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:20.681571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:20.682344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:20.682784 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:20.809767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:20.817748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-658f35c7-2fce-4244-9651-519b223dd3a8 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.148177 Jun 06 12:12:20.818319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 404/814] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:20 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:21.345091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:21.345691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:21.352408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:21.352846 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:21.353594 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:21.354018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:21.490433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:21.498818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:21.500385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:21.501531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-992fbc96-9437-460f-b8e6-1e6bdb1894a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.160878 Jun 06 12:12:21.502380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 411/815] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:21 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:21.584189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-1420f387-df3f-4428-8823-ea23b5f87a56 req-461b8496-5185-4dcb-ba10-f6452ce8ed53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c3c40c-4b64-469a-b62f-0ce6159522fc", "name": "network-vif-plugged", "status": "completed", "tag": "5f5f0542-4e21-4640-836a-cff2c187ebcf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:21.593583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1420f387-df3f-4428-8823-ea23b5f87a56 req-461b8496-5185-4dcb-ba10-f6452ce8ed53 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:21.594042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1420f387-df3f-4428-8823-ea23b5f87a56 req-461b8496-5185-4dcb-ba10-f6452ce8ed53 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:21.598352 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:21.605759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-1420f387-df3f-4428-8823-ea23b5f87a56 req-461b8496-5185-4dcb-ba10-f6452ce8ed53 service nova] Creating event network-vif-plugged:5f5f0542-4e21-4640-836a-cff2c187ebcf for instance 76c3c40c-4b64-469a-b62f-0ce6159522fc on hv-cinder-82549 Jun 06 12:12:21.614225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-1420f387-df3f-4428-8823-ea23b5f87a56 req-461b8496-5185-4dcb-ba10-f6452ce8ed53 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031240 Jun 06 12:12:21.614225 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 405/816] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:21.835187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:21.835834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:21.842130 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:21.842651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:21.843445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:21.843879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:21.971615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:21.978986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7fdc6c69-5864-4c70-84a5-6d136d5c64dd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.147586 Jun 06 12:12:21.979591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 412/817] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:21 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:22.521365 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:22.522064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:22.530337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:22.530779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:22.531562 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:22.531998 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:22.666081 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:22.674334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:22.675878 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:22.677034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3178fb1a-feca-4cc2-9a64-55f253a22380 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.160302 Jun 06 12:12:22.677597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 406/818] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:22 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:22.995902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:22.996532 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:22.999444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:23.000095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:23.006264 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:23.006711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:23.007515 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:23.007947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:23.152015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:23.159494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-660ff90e-b31a-428a-a3e3-caa04d78e98d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1365 microversion: 2.1 time: 0.167408 Jun 06 12:12:23.160084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 413/819] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:22 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:23.695574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:23.696188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:23.698159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:23.704647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:23.705101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:23.705871 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:23.706303 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:23.840860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:23.849844 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:23.851463 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:23.852684 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7c5f1d94-d48b-450e-a745-a511519fb523 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.161077 Jun 06 12:12:23.853278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 407/820] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:23 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:24.175755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:24.176358 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:24.182755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.183222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:24.183969 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.184395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:24.188217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:24.318087 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:24.325553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-88b14dee-0a8d-4ed9-ae54-2eb56a4046f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1554 microversion: 2.1 time: 0.153789 Jun 06 12:12:24.326120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 414/821] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:12:24 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:12:24.342541 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:24.343090 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:24.349866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.350314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:24.351122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.351555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:24.435018 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4aa9c90f-ccac-4c51-a358-bfe8df42618c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096508 Jun 06 12:12:24.435613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 408/822] 10.222.0.41 () {58 vars in 1274 bytes} [Mon Jun 6 12:12:24 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:24.871959 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:24.872569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:24.879234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.879682 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:24.880444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:24.880884 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:25.125683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:25.133671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:25.135188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:25.136394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a99e4e56-bb93-4e49-8389-adfd05699d42 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.268390 Jun 06 12:12:25.137167 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 415/823] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:24 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:25.431761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-78929a62-a24a-4fa8-a6ff-1226794e8a98 req-08f6360a-e745-4435-a2f9-c992a1f23d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c3c40c-4b64-469a-b62f-0ce6159522fc", "tag": "5f5f0542-4e21-4640-836a-cff2c187ebcf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:25.440001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-78929a62-a24a-4fa8-a6ff-1226794e8a98 req-08f6360a-e745-4435-a2f9-c992a1f23d18 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:25.440449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-78929a62-a24a-4fa8-a6ff-1226794e8a98 req-08f6360a-e745-4435-a2f9-c992a1f23d18 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:25.451701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-78929a62-a24a-4fa8-a6ff-1226794e8a98 req-08f6360a-e745-4435-a2f9-c992a1f23d18 service nova] Creating event network-changed:5f5f0542-4e21-4640-836a-cff2c187ebcf for instance 76c3c40c-4b64-469a-b62f-0ce6159522fc on hv-cinder-82549 Jun 06 12:12:25.456757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-78929a62-a24a-4fa8-a6ff-1226794e8a98 req-08f6360a-e745-4435-a2f9-c992a1f23d18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029118 Jun 06 12:12:25.457422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 409/824] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:26.155068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:26.155747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:26.162319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:26.162770 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:26.163583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:26.164022 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:26.297994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:26.306262 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:26.307920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:26.309092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c3d75555-80de-4b16-ae93-00ca213c2725 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.158020 Jun 06 12:12:26.309658 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 416/825] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:26 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:27.329550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:27.330246 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:27.336454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:27.336894 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:27.337645 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:27.338072 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:27.475709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:27.483643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:27.485179 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:27.486337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4c3823eb-7818-4559-bef6-9c78a77bb1f1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.162008 Jun 06 12:12:27.486920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 410/826] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:27 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:28.504724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:28.505260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:28.511728 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:28.512169 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:28.512918 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:28.513346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:28.639601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:28.648442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:28.649960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:28.651116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-28ff83fd-ef0c-4f5b-91f9-b6ef9b8d050a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.150291 Jun 06 12:12:28.651674 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 417/827] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:28 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:29.669952 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:29.670567 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:29.673076 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:29.678357 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:29.678804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:29.679623 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:29.680057 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:29.813769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:29.821583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:29.823191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:29.824341 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-52573d40-56f6-4ada-9516-e9ff41833b24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.158317 Jun 06 12:12:29.824899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 411/828] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:29 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:30.843068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:30.843750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:30.846030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:30.852491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:30.853080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:30.853833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:30.854261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:30.984653 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:30.992482 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:30.993965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:30.995124 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1ad44f88-2778-45de-a21d-985d8e061b48 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.156299 Jun 06 12:12:30.995676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 418/829] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:30 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:32.013400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:32.014006 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:32.021112 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:32.021567 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:32.022340 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:32.022781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:32.156351 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:32.164347 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:32.165963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:32.167146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-96f5ff30-1e53-49a1-866e-463ca7dfb0f2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.157581 Jun 06 12:12:32.167714 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 412/830] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:32 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:33.186504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:33.187405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:33.193736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:33.194184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:33.194983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:33.195426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:33.320813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:33.329502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:33.331038 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:33.332185 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-812c18e7-b462-4b76-9ad6-a1c4a97c11e5 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.150398 Jun 06 12:12:33.332754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 419/831] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:33 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:34.350614 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:34.351246 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:34.357761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:34.358202 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:34.359322 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:34.359798 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:34.493627 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:34.502920 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:34.504411 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:34.505577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f3319a45-aa5d-425d-b9fc-5f7a103b6cbb tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.158801 Jun 06 12:12:34.506138 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 413/832] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:34 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:35.524093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:35.524704 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:35.532857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:35.533305 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:35.534077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:35.534512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:35.668393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:35.676649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:35.678146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:35.679321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-244e2020-322b-493f-a7f7-e07f7c9831db tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.159142 Jun 06 12:12:35.679879 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 420/833] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:35 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:36.698033 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:36.698650 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:36.705193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:36.705639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:36.706404 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:36.706857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:36.836526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:36.844826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:36.846342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:36.847538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bcda0895-93cd-4ad7-a112-b75733c9f094 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1745 microversion: 2.20 time: 0.153462 Jun 06 12:12:36.848127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 414/834] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:36 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:37.866086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:37.866686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:37.873084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:37.873555 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:37.875223 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:37.875651 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:38.006288 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:38.014226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:38.016591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:38.017746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-41ee94bc-6232-4298-be0c-1e88b1e5c0cc tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1745 microversion: 2.20 time: 0.156223 Jun 06 12:12:38.018436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 421/835] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:37 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:39.036420 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:39.037037 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:39.043607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:39.044062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:39.044824 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:39.045264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:39.175245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:39.183064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:39.184547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:39.185677 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b7ea4563-058a-42d6-b4e9-bbe5a04d975d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1745 microversion: 2.20 time: 0.153224 Jun 06 12:12:39.186236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 415/836] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:39 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:39.612267 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-c39ca6d7-fb60-4365-ab8e-b060f8c2bb4c req-ae608ec5-c837-47dd-8472-dfe55e279997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "name": "network-vif-plugged", "status": "completed", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:39.622527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c39ca6d7-fb60-4365-ab8e-b060f8c2bb4c req-ae608ec5-c837-47dd-8472-dfe55e279997 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:39.623005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-c39ca6d7-fb60-4365-ab8e-b060f8c2bb4c req-ae608ec5-c837-47dd-8472-dfe55e279997 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:39.634809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-c39ca6d7-fb60-4365-ab8e-b060f8c2bb4c req-ae608ec5-c837-47dd-8472-dfe55e279997 service nova] Creating event network-vif-plugged:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:12:39.640583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-c39ca6d7-fb60-4365-ab8e-b060f8c2bb4c req-ae608ec5-c837-47dd-8472-dfe55e279997 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Jun 06 12:12:39.641432 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 422/837] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:12:40.204393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:40.205093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:40.212048 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:40.212500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:40.213271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:40.213708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:40.345746 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:40.353725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:40.355268 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:40.356418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e3a42f86-5700-47c5-8a06-b17c5d5fc99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1745 microversion: 2.20 time: 0.156145 Jun 06 12:12:40.356979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 416/838] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:40 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:41.376232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:41.376922 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:41.384777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:41.385224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:41.386007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:41.386446 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:41.525927 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:41.534572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:41.536097 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:41.537238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1451aca2-0101-46b7-b24c-5c52a2c5ba89 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1745 microversion: 2.20 time: 0.165325 Jun 06 12:12:41.537792 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 423/839] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:41 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:42.557444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:42.558064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:42.565369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:42.565814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:42.566577 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:42.567044 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:42.709521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:42.718453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:42.720294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:42.721841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d17e75c1-88c2-4ea0-ab79-638906a9050d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.169065 Jun 06 12:12:42.722608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 417/840] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:42 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:43.741034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:43.741958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:43.748981 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:43.750260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:43.751072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:43.751508 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:43.901945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:43.911642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:43.913172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:43.914539 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d788ecd8-e9f8-43f3-b80c-e7e8d19a3e24 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.177422 Jun 06 12:12:43.925317 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 424/841] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:43 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:44.932725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:44.934010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:44.941719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:44.942319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:44.943106 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:44.943708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:45.082675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:45.092488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:45.095274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:45.097528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-33a1cec5-1000-4d7f-b543-7db26f3878b9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.168400 Jun 06 12:12:45.098350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 418/842] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:44 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:46.116026 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:46.116640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:46.123136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:46.123586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:46.124605 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:46.125178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:46.262735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:46.270946 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:46.272379 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:46.273527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-02f56d24-8e16-4e68-ad0e-bfd372b16bb3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.161521 Jun 06 12:12:46.274088 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 425/843] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:46 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:47.293071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:47.293597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:47.301291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:47.301826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:47.302596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:47.303059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:47.449331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:47.459530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:47.461392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:47.462719 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b3cd1698-fbe0-4706-be27-c7ecdd60b648 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.173711 Jun 06 12:12:47.463615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 419/844] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:47 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:48.481876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:48.482489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:48.489377 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:48.489827 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:48.490584 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:48.491044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:48.629023 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:48.637630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:48.639380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:48.640742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f47c51d0-d2e5-4915-b3d5-b1bd25985214 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.162890 Jun 06 12:12:48.641699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 426/845] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:48 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:49.659587 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:49.660168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:49.666511 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:49.666986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:49.668174 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:49.668808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:49.812380 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:49.820507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:49.822016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:49.823198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-347d0bb1-6f23-4425-a5bb-bce16cd81d5c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.167948 Jun 06 12:12:49.823764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 420/846] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:49 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:50.841757 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:50.842664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:50.850247 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:50.850699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:50.851525 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:50.851965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:51.013120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:51.023347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:51.025093 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:51.026299 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e27f2b62-a3ec-4d3a-8a54-8ab3f143cfcd tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.188706 Jun 06 12:12:51.033543 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 427/847] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:50 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:52.046194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:52.047005 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:52.054451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:52.054972 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:52.055755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:52.056231 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:52.197664 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:52.207198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:52.209042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:52.210323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f10d85d7-2919-41b2-b986-709475b483e8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.168584 Jun 06 12:12:52.211278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 421/848] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:52 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:53.229572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:53.230739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:53.239392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:53.239828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:53.240600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:53.241029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:53.388031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:53.397366 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:53.399313 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:53.400478 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-910788b2-b9c1-4056-aeb6-55a9edc85943 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.175038 Jun 06 12:12:53.401248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 428/849] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:53 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:54.419355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:54.419996 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:54.427356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:54.427794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:54.428542 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:54.428970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:54.432797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=91 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:54.557942 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:54.566568 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:54.568181 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:54.569382 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9acd42c0-6db8-4ca8-9a2c-5d7d8dc2ec98 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1740 microversion: 2.20 time: 0.154034 Jun 06 12:12:54.569964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 422/850] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:54 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:55.587569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:55.588175 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:55.595423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:55.595833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:55.596748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:55.597189 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:55.600028 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=85 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:12:55.732948 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:55.741593 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:55.743200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:55.744345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9d93fe90-dcef-4a85-821d-b6ea927c6e20 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1722 microversion: 2.20 time: 0.160650 Jun 06 12:12:55.744909 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 429/851] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:55 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:56.764000 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:56.764590 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:56.771927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:56.772369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:56.773124 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:56.773554 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:56.897796 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:56.905646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:56.907168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:56.908447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4ddea2ac-4324-4543-a7c7-23d42e849394 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1722 microversion: 2.20 time: 0.148398 Jun 06 12:12:56.909111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 423/852] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:56 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:57.746186 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-995efc5f-f5f7-4c3a-b510-a564a0df17c2 req-2f257225-6d3c-4ce2-9029-7cd800b73656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "name": "network-vif-unplugged", "status": "completed", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:57.755318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-995efc5f-f5f7-4c3a-b510-a564a0df17c2 req-2f257225-6d3c-4ce2-9029-7cd800b73656 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:57.755761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-995efc5f-f5f7-4c3a-b510-a564a0df17c2 req-2f257225-6d3c-4ce2-9029-7cd800b73656 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:57.767363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.compute.server_external_events [req-995efc5f-f5f7-4c3a-b510-a564a0df17c2 req-2f257225-6d3c-4ce2-9029-7cd800b73656 service nova] Unable to find a host for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec. Dropping event network-vif-unplugged {{(pid=117629) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 12:12:57.768233 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-995efc5f-f5f7-4c3a-b510-a564a0df17c2 req-2f257225-6d3c-4ce2-9029-7cd800b73656 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025918 Jun 06 12:12:57.768809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 430/853] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 12:12:57.927435 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:57.927973 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:57.934423 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:57.934893 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:57.935659 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:57.936096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.070549 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:58.078460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:58.080783 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:58.081919 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-8a5e9479-54ee-4c18-8c93-a6436f487348 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1665 microversion: 2.20 time: 0.159162 Jun 06 12:12:58.082475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 424/854] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:57 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:12:58.100458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ca61918-dd19-4368-945c-c1b00e5f9fd1"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:58.101499 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:58.107418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.107862 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.108607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.109031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.380469 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fead7b80-a3a6-4541-843d-acc96b0d7441 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.283817 Jun 06 12:12:58.381133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 431/855] 10.222.0.41 () {62 vars in 1363 bytes} [Mon Jun 6 12:12:58 2022] POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments => generated 188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 12:12:58.494782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:58.495323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:58.501213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.502001 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.502768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.503224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.733543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3228ada4-5095-4718-8004-51fe80d390e0 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments/3ca61918-dd19-4368-945c-c1b00e5f9fd1" status: 202 len: 0 microversion: 2.20 time: 0.242409 Jun 06 12:12:58.734184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 425/856] 10.222.0.41 () {60 vars in 1456 bytes} [Mon Jun 6 12:12:58 2022] DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments/3ca61918-dd19-4368-945c-c1b00e5f9fd1 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 12:12:58.789283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:12:58.789843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:58.796863 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.797309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.798061 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.798489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.873965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f9380855-376c-4574-aafb-443afcff674e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/action" status: 202 len: 0 microversion: 2.20 time: 0.088716 Jun 06 12:12:58.874559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 432/857] 10.222.0.41 () {62 vars in 1318 bytes} [Mon Jun 6 12:12:58 2022] POST /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:12:58.883513 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:12:58.884128 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:12:58.890324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.890774 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:58.891573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:12:58.892008 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:12:59.029040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:59.037121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:59.038656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:12:59.039876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0a8a69f5-c401-4c25-825a-16f170fd7a0c tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1673 microversion: 2.20 time: 0.160359 Jun 06 12:12:59.040443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 426/858] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:12:58 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:00.058938 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:00.059679 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:00.066453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:00.066919 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:00.067676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:00.068103 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:00.201761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:00.210237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:00.211785 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:00.212944 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-942becf8-30b9-4725-ac56-bf0f0ea4c7d8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.158393 Jun 06 12:13:00.213510 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 433/859] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:00 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:01.233336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:01.233924 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:01.236701 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=32 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:01.242808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:01.243470 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:01.244249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:01.244716 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:01.381248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:01.396119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:01.397864 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:01.399274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e793c279-19d2-452b-8ca8-e762d3c5364a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.170171 Jun 06 12:13:01.400199 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 427/860] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:01 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:02.418788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:02.419548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:02.426469 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=34 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:02.428747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:02.429210 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:02.429961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:02.430397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:02.833575 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:02.847558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:02.849312 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:02.850501 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-952a2bfd-fec8-4542-835e-cb76fb971162 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.436009 Jun 06 12:13:02.851107 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 434/861] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:02 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:03.705403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:03.706097 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:03.707417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d5e1bb67-87ba-4056-92a6-75f7d7b9505c req-e3b34256-ce6a-4c52-887b-fbf4b4bfda2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:03.712586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.712752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.713507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.713946 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.716712 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d5e1bb67-87ba-4056-92a6-75f7d7b9505c req-e3b34256-ce6a-4c52-887b-fbf4b4bfda2e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.717230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d5e1bb67-87ba-4056-92a6-75f7d7b9505c req-e3b34256-ce6a-4c52-887b-fbf4b4bfda2e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.729337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d5e1bb67-87ba-4056-92a6-75f7d7b9505c req-e3b34256-ce6a-4c52-887b-fbf4b4bfda2e service nova] Creating event network-changed:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:13:03.735252 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d5e1bb67-87ba-4056-92a6-75f7d7b9505c req-e3b34256-ce6a-4c52-887b-fbf4b4bfda2e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 Jun 06 12:13:03.736249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 435/862] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:03.760074 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:13:03.845776 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e45287d5-7c0e-4d20-9f1f-9be7c891933f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 204 len: 0 microversion: 2.1 time: 0.144418 Jun 06 12:13:03.846491 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 428/863] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:13:03 2022] DELETE /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:13:03.857672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:03.858643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:03.867270 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.867720 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.868646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.869423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.870690 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:03.873508 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:03.884646 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.885384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:03.886656 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:03.887324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:04.110425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:04.121138 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fe2e086d-67aa-4505-924f-d21f6be4c970 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.268743 Jun 06 12:13:04.121725 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 436/864] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:03 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:04.136154 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:04.145492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:04.147114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:04.148313 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6a7f3951-a512-424d-b04c-8146a6ef1957 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.282452 Jun 06 12:13:04.158978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 429/865] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:03 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:05.077327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:05.078214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:05.086674 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.087151 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.088007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.088453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.112871 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-53d12b23-96eb-4a38-bab5-84278e8ac2c8 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/ips" status: 200 len: 145 microversion: 2.1 time: 0.041105 Jun 06 12:13:05.113448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 437/866] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:13:05 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:05.139120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:05.139737 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:05.147751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.148199 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.149085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.149524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.166697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:05.167343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:05.179928 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.180381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.181168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:05.181610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:05.355118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:05.366441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6f81c0f1-001b-486f-86d9-2c38975f8813 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.230817 Jun 06 12:13:05.367184 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 430/867] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:05 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:05.388926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:05.402952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:05.404654 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:05.405828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4e360d20-1d21-419b-8502-bc824ae1c7e9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.243082 Jun 06 12:13:05.406890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 438/868] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:05 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:06.385370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:06.385982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:06.392442 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.392926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.393690 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.394122 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.437056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:06.437807 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:06.457446 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.457967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.459208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.459768 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.629285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:06.637093 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-555742cc-622c-46a9-9ef7-6df10add7aba tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.255564 Jun 06 12:13:06.637681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 431/869] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:06 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:06.647450 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff2f9940-c749-4b7d-87c9-f97b61255bea"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:06.656530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:06.657645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:06.664310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.664907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.665709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:06.666223 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:06.667569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:06.669226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:06.670372 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-df008f4f-14fd-45e6-8969-e92ef905c5c4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.248452 Jun 06 12:13:06.670955 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 439/870] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:06 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:07.654971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:07.655630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:07.662885 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:07.663340 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:07.664116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:07.664558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:07.802019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:07.809725 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-249e92e6-a9d2-4747-870a-02852ce77827 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.158750 Jun 06 12:13:07.810337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 440/871] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:07 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:07.814778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:07.816025 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:07.821958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:07.822403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:07.823196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:07.823629 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:07.977118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:07.984866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:07.986348 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:07.987643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-269776ac-f506-43d1-8f5f-bf433596885f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.176408 Jun 06 12:13:07.988201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 441/872] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:07 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:08.827777 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:08.828492 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:08.835615 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:08.836066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:08.836828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:08.837258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:08.977681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:08.985802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-af84410c-da93-4fca-b104-f363720e95bc tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.161954 Jun 06 12:13:08.986570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 442/873] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:08 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:09.006480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:09.007122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:09.014096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:09.014551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:09.015360 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:09.015838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:09.154410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:09.156735 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:09.164932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:09.167396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:09.168765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03f52642-efd3-4708-9097-de4ecc98c8d3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.166966 Jun 06 12:13:09.169338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 443/874] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:09 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:10.004287 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:10.004968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:10.013227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:10.013799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:10.014583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:10.015188 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:10.169013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:10.179167 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b99dc164-d192-4baa-a82c-8d294361edcb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.179557 Jun 06 12:13:10.189214 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 444/875] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:09 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:10.189861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:10.190468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:10.196744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:10.197185 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:10.197943 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:10.198371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:10.330201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:10.338209 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:10.339758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:10.340902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aa401f70-43f6-4fac-9a2c-8e7bf08552b1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.155136 Jun 06 12:13:10.341740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 445/876] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:10 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:11.198354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:11.199158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:11.205570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:11.206217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:11.207176 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:11.207607 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:11.349335 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:11.356842 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-961f90f0-ba16-41d1-9214-9e340e8c9c58 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.162608 Jun 06 12:13:11.357422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 446/877] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:11 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:11.362508 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:11.363134 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:11.368864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:11.369319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:11.370085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:11.370523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:11.515480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:11.524655 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:11.526169 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:11.527382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-34c6ffa9-2b7e-4f44-827a-9cb34fd4ed9e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.168976 Jun 06 12:13:11.528117 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 447/878] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:11 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:12.374878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:12.375604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:12.382623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:12.383111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:12.383875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:12.384313 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:12.515934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:12.524197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cd2cba89-7560-4817-9e48-44cc0347dcd0 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.153303 Jun 06 12:13:12.524766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 448/879] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:12 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:12.548740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:12.549421 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:12.555435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:12.555878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:12.556626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:12.557054 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:12.843413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:12.851378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:12.852874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:12.854013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0b92451e-1578-418d-842b-76d81de2d499 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.311475 Jun 06 12:13:12.854816 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 449/880] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:12 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:13.541100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:13.541773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:13.548159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:13.548604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:13.549353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:13.549784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:13.683053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:13.690487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e64be2c-60f6-4552-bb52-a061bededeeb tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.153193 Jun 06 12:13:13.691151 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 450/881] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:13 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:13.872346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:13.872957 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:13.879600 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:13.880047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:13.880808 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:13.881245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:14.007464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:14.015663 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:14.017694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:14.018369 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3491dd79-1819-45a9-aab0-91dbf7f7957e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.150011 Jun 06 12:13:14.018944 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 451/882] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:13 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:14.709352 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:14.710005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:14.716395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:14.717089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:14.717843 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:14.718284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:14.852326 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:14.860432 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5672abea-76c0-4f47-944c-3a7078f54068 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.155471 Jun 06 12:13:14.861337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 452/883] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:14 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:15.036972 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:15.037577 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:15.043540 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:15.043984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:15.044731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:15.045172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:15.171748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:15.180006 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:15.181502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:15.182647 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-eae13ce6-4f78-4c09-9cfd-9e4f661c91ce tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.149719 Jun 06 12:13:15.183480 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 453/884] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:15 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:15.878823 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:15.879506 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:15.885995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:15.886433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:15.887211 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:15.887638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:16.025433 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:16.032831 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-be30d060-c285-4c61-943e-dc2e6cd01b42 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.157848 Jun 06 12:13:16.033389 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 454/885] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:15 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:16.201533 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:16.202055 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:16.208977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:16.209416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:16.210170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:16.210633 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:16.343825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:16.352445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:16.353932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:16.355112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-abf0f8a9-3506-4bdb-9a5f-3d9987ed1709 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.157512 Jun 06 12:13:16.355659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 455/886] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:16 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:16.661722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:16.757356 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:17.049628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:17.050874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:17.058377 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:17.058825 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:17.059637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:17.060072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:17.197464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:17.205274 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4dbbc4af-e112-47fc-9514-843788dee624 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.159641 Jun 06 12:13:17.205839 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 456/887] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:17 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:17.373077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:17.373681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:17.379714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:17.380166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:17.380977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:17.381431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:17.508378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:17.516274 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:17.517796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:17.518962 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-671da022-2be2-45c1-a934-8a136a6996f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.149667 Jun 06 12:13:17.519526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 457/888] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:17 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:18.222970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:18.223677 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:18.229741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:18.230189 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:18.230971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:18.231408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:18.366755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:18.374284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7b69d849-f99b-4229-90ec-e5e7225ec0a7 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.155265 Jun 06 12:13:18.374859 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 458/889] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:18 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:18.539776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:18.540378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:18.546976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:18.547416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:18.548164 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:18.548591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:18.681322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:18.689627 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:18.691171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:18.692836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-601b0f0b-b2e9-4c39-920f-61a716cddaf9 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.157894 Jun 06 12:13:18.693393 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 459/890] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:18 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:13:19.391961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:19.393001 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:19.398800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:19.399284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:19.400053 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:19.400491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:19.415708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=100 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:19.530571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:19.538558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-33894713-89a3-43ac-a3ff-9b09d2ceae32 tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1568 microversion: 2.1 time: 0.150522 Jun 06 12:13:19.539166 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 460/891] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:19 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:19.711871 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:19.712401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:19.719376 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:19.719799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:19.720573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:19.721012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:19.843207 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-997af738-ebfd-41f8-b98a-b409af551af1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.203875 Jun 06 12:13:19.844597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 432/892] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:13:06 2022] POST /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 194 bytes in 13206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:19.884029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:19.893434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:19.898286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:19.900657 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-86de5def-4f26-44d0-ba2d-3287ece563a1 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.193525 Jun 06 12:13:19.902181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 461/893] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:19 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:20.553992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-3563316d-a84f-4b26-b9bf-90343f5014bd req-40a6dfa7-2f76-473d-bc30-b1b0966080f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd40cde6-b921-44c9-a864-e5d2ad7273c9", "name": "network-vif-deleted", "tag": "770e9dcf-d852-4ba2-8d8c-8d104499221f"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:20.555693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:20.556309 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:20.562384 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:20.562833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:20.563187 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3563316d-a84f-4b26-b9bf-90343f5014bd req-40a6dfa7-2f76-473d-bc30-b1b0966080f9 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:20.563624 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:20.563735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3563316d-a84f-4b26-b9bf-90343f5014bd req-40a6dfa7-2f76-473d-bc30-b1b0966080f9 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:20.564063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:20.575111 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-3563316d-a84f-4b26-b9bf-90343f5014bd req-40a6dfa7-2f76-473d-bc30-b1b0966080f9 service nova] Creating event network-vif-deleted:770e9dcf-d852-4ba2-8d8c-8d104499221f for instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 on hv-cinder-82549 Jun 06 12:13:20.580119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-3563316d-a84f-4b26-b9bf-90343f5014bd req-40a6dfa7-2f76-473d-bc30-b1b0966080f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030887 Jun 06 12:13:20.580781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 433/894] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:20.627671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '567389c79da54aec809e004e4bde99e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43703500ab064d7091826ea7870273fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:20.636249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99f195d0-f627-46f2-bc9c-770a8d1565ac tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 200 len: 1382 microversion: 2.1 time: 0.084304 Jun 06 12:13:20.636840 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 462/895] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:20 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 1382 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:20.923326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:20.924115 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:20.932754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:20.933596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:20.934671 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:20.935337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:21.086510 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:21.094652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:21.096178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:21.097372 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d87dbf7a-a997-4712-958d-61b6eafd83ed tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.179462 Jun 06 12:13:21.097951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 434/896] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:20 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:21.654019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:21.654545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] [instance: cd40cde6-b921-44c9-a864-e5d2ad7273c9] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:21.660978 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:21.661506 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:21.662273 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:21.662718 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:21.677765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] HTTP exception thrown: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Request method failure captured: Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 HTTP/1.1 Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine3RtdY4YGXie8wqq6HaQYJTA6ragouyt3l-ip9dA0yYhriYnCnLSht50O_wY4MQxEItffWCGrKSTwnjJRoZKo6WV8yxyWPCOElzOb8Ii6AGJUzuX5AKSInb6KgDVR6OFmoGEqW8PFmSc_w3ggaGKzDGPFAMPDZ1FnUt8kdmfkrLFHg Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 43703500ab064d7091826ea7870273fb Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestShelveInstance-483041567 Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:13:21.679429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43703500ab064d7091826ea7870273fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_43703500ab064d7091826ea7870273fb", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/43703500ab064d7091826ea7870273fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/43703500ab064d7091826ea7870273fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestShelveInstance-483041567 Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 43703500ab064d7091826ea7870273fb Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestShelveInstance-483041567 Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-TestShelveInstance-483041567-project Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 567389c79da54aec809e004e4bde99e5 Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestShelveInstance-483041567-project Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. Jun 06 12:13:21.681106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'cd40cde6-b921-44c9-a864-e5d2ad7273c9'} Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:21.682108 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. Jun 06 12:13:21.683661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:21.685031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Returning 404 to user: Instance cd40cde6-b921-44c9-a864-e5d2ad7273c9 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:21.685031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1612f840-6507-4798-bc7d-ec7969f0f36f tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9" status: 404 len: 111 microversion: 2.1 time: 0.030745 Jun 06 12:13:21.685031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 463/897] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:21 2022] GET /compute/v2.1/servers/cd40cde6-b921-44c9-a864-e5d2ad7273c9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:13:21.846217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-00f32680-0718-4d6f-8b99-6ae8308076bf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] Calling method '.version_select at 0x7fc15b6cfa60>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:21.869585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-00f32680-0718-4d6f-8b99-6ae8308076bf tempest-TestShelveInstance-483041567 tempest-TestShelveInstance-483041567-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1133469723" status: 202 len: 0 microversion: 2.1 time: 0.028009 Jun 06 12:13:21.870799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 435/898] 10.222.0.41 () {58 vars in 1253 bytes} [Mon Jun 6 12:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1133469723 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:13:21.954184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-b296091e-9dab-47a4-8fee-ae752fc2dc71 req-a67184a9-f5bb-4d02-a6af-14910cb3bf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "name": "network-vif-plugged", "status": "completed", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:21.965274 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b296091e-9dab-47a4-8fee-ae752fc2dc71 req-a67184a9-f5bb-4d02-a6af-14910cb3bf4f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:21.965851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b296091e-9dab-47a4-8fee-ae752fc2dc71 req-a67184a9-f5bb-4d02-a6af-14910cb3bf4f service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:21.979601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-b296091e-9dab-47a4-8fee-ae752fc2dc71 req-a67184a9-f5bb-4d02-a6af-14910cb3bf4f service nova] Creating event network-vif-plugged:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:13:21.984559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-b296091e-9dab-47a4-8fee-ae752fc2dc71 req-a67184a9-f5bb-4d02-a6af-14910cb3bf4f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033999 Jun 06 12:13:21.985140 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 464/899] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:22.116617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:22.117223 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:22.124218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:22.124663 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:22.125483 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:22.126147 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:22.262384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:22.270374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:22.271986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:22.273131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-225e5cd2-ebb7-4d3b-8a91-5907e0c5094e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.161024 Jun 06 12:13:22.273681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 436/900] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:22 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:23.292551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:23.293275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:23.299526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:23.300044 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:23.300878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:23.301381 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:23.449724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:23.457813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:23.460168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:23.461318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d75e245e-96cb-497f-82ea-ed5536eac642 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.173686 Jun 06 12:13:23.461876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 465/901] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:23 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:24.494198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:24.495273 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:24.512047 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:24.512711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:24.513687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:24.514283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:24.766302 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:24.775751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:24.777550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:24.778795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6797470b-b12f-426e-b9fb-29cc2ea42837 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1731 microversion: 2.20 time: 0.300516 Jun 06 12:13:24.779500 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 437/902] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:24 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1731 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:25.797296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:25.798030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:25.805464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:25.805913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:25.806692 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:25.807217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:26.024043 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:26.035650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:26.037744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:26.039364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1b85b5a7-80be-4248-965e-ac173547f5f4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1718 microversion: 2.20 time: 0.245953 Jun 06 12:13:26.039928 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 466/903] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:13:25 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1718 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:13:27.443960 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:27.444906 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:27.451384 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:27.451832 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:27.452597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:27.453025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:27.485733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e8e2657a-4fdc-41ca-9f3f-e0a1a71ee637 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 Jun 06 12:13:27.486299 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 438/904] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:27 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:27.496300 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:27.496798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:27.503565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:27.504005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:27.504779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:27.505497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:27.545391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d4ad228d-16bf-4e87-b027-c46e5c117405 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea" status: 200 len: 194 microversion: 2.1 time: 0.050454 Jun 06 12:13:27.546604 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 467/905] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 12:13:27 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:28.912251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3010861-cf9f-422f-b36a-b6aed6cfafa7"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:28.913928 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:28.920027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:28.920478 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:28.921246 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:28.921685 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:29.196101 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e8237920-4ad4-4584-81a8-80006a199f66 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "POST /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288139 Jun 06 12:13:29.201330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 439/906] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:13:28 2022] POST /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:36.685128 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:36.686772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:36.690803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=68 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:36.699092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.699548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:36.700317 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.700760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:36.730495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6f8fc24c-e20e-4797-848a-faf8d6515f30 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049573 Jun 06 12:13:36.731153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 468/907] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:36 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:36.870216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:36.870733 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:36.876945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.877387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:36.878137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.878566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:36.907363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c39b854e-709e-48d7-bc13-0eb261c2c90b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea" status: 200 len: 194 microversion: 2.1 time: 0.042346 Jun 06 12:13:36.907926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 440/908] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 12:13:36 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:36.917400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:36.917894 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:36.923833 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.924280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:36.925033 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:36.925468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:37.004382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lazy-loading 'services' on Instance uuid 07fca81c-28df-4c59-8a0f-73f0ca291fb3 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:13:37.077505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-96e41f94-b5e5-4b7d-95c8-eef876e1fe8a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea" status: 202 len: 0 microversion: 2.1 time: 0.163856 Jun 06 12:13:37.078225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 469/909] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:13:36 2022] DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/ff2f9940-c749-4b7d-87c9-f97b61255bea => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:13:39.240171 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:39.240684 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:39.247671 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:39.248117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:39.248873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:39.249303 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:39.277471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-125490eb-fc83-4a8e-a2ab-241e185377d4 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/f3010861-cf9f-422f-b36a-b6aed6cfafa7" status: 200 len: 194 microversion: 2.1 time: 0.041270 Jun 06 12:13:39.278027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 441/910] 10.222.0.41 () {58 vars in 1412 bytes} [Mon Jun 6 12:13:39 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/f3010861-cf9f-422f-b36a-b6aed6cfafa7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:13:39.289456 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:39.290051 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:39.296353 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:39.296803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:39.297564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:39.298004 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:39.377760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lazy-loading 'services' on Instance uuid 07fca81c-28df-4c59-8a0f-73f0ca291fb3 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:13:39.448873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99358ebc-9e82-43aa-b007-0e9653975a86 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/f3010861-cf9f-422f-b36a-b6aed6cfafa7" status: 202 len: 0 microversion: 2.1 time: 0.164770 Jun 06 12:13:39.449470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 470/911] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:13:39 2022] DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments/f3010861-cf9f-422f-b36a-b6aed6cfafa7 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:13:40.605391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:40.606415 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:40.612814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.613263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.614021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.614454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.642923 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b1a33126-4612-4a1f-9e93-28d299cc7d78 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041862 Jun 06 12:13:40.643407 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 442/912] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:40 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:13:40.746613 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:40.747714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:40.753913 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.754361 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.755159 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.755596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.793116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-cf97b1e7-8422-4c55-a7a3-6c5899b0e2f5 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051763 Jun 06 12:13:40.793676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 471/913] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:40 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:13:40.855283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:40.855782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:40.862071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.862597 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.863598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.864042 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.888393 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:13:40.965260 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5a9fc85e-6400-4735-ba1c-bb388e06c659 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 204 len: 0 microversion: 2.1 time: 0.114160 Jun 06 12:13:40.965807 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 443/914] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:13:40 2022] DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:13:40.974106 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:40.974870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:40.981764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.982203 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:40.983010 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:40.983444 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:41.129029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:41.138699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5d8fce0b-cb0f-4a70-9bdd-c3f9fe059203 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1672 microversion: 2.1 time: 0.168394 Jun 06 12:13:41.139303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 472/915] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:40 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:42.157856 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:42.158554 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:42.165569 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:42.166012 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:42.166773 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:42.167236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:42.300334 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:42.307949 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6aa7384e-9e02-409c-924f-4f4a878ae1be tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1672 microversion: 2.1 time: 0.154543 Jun 06 12:13:42.308524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 444/916] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:42 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:43.324776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:43.325397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:43.331888 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:43.332371 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:43.333136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:43.333576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:43.554790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:43.555412 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:43.561637 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:43.562089 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:43.562877 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:43.563317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:43.590529 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cc3bf51d-9cad-4b86-8db2-5d58980fadc6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/ips" status: 200 len: 148 microversion: 2.1 time: 0.040722 Jun 06 12:13:43.591337 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 445/917] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:13:43 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:13:43.678021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:43.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f5ef3484-b19b-4c21-9ddd-925bfcea547b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1672 microversion: 2.1 time: 0.366765 Jun 06 12:13:43.689755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 473/918] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:43 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:13:44.276805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-3bffac33-d735-4ebe-a3fb-bbbe55fe77b3 req-264d6e9c-ac8a-4a56-b42a-f737e880fcfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07fca81c-28df-4c59-8a0f-73f0ca291fb3", "name": "network-vif-deleted", "tag": "f1faca20-5372-4608-9976-7e6da17ee460"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:44.285812 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3bffac33-d735-4ebe-a3fb-bbbe55fe77b3 req-264d6e9c-ac8a-4a56-b42a-f737e880fcfe service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.286189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3bffac33-d735-4ebe-a3fb-bbbe55fe77b3 req-264d6e9c-ac8a-4a56-b42a-f737e880fcfe service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:44.298471 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-3bffac33-d735-4ebe-a3fb-bbbe55fe77b3 req-264d6e9c-ac8a-4a56-b42a-f737e880fcfe service nova] Creating event network-vif-deleted:f1faca20-5372-4608-9976-7e6da17ee460 for instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 on hv-cinder-82549 Jun 06 12:13:44.303617 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-3bffac33-d735-4ebe-a3fb-bbbe55fe77b3 req-264d6e9c-ac8a-4a56-b42a-f737e880fcfe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Jun 06 12:13:44.305350 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 446/919] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:44.707096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:44.707742 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:44.715401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.715856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:44.716638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.717080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:44.754220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.754665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:44.755139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lazy-loading 'fault' on Instance uuid 07fca81c-28df-4c59-8a0f-73f0ca291fb3 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:13:44.803599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c904a413f6a4ba49686debac817c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffaf09bc77914692bb965b55af538141', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:44.811770 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a618e71c-8302-48f1-aac6-1cc4bb9ce82b tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 200 len: 1327 microversion: 2.1 time: 0.108565 Jun 06 12:13:44.812406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 474/920] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:44 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:44.920146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c428ef6-e548-48ff-a3f3-c81b68003e28"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:44.921433 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:44.927726 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.928415 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:44.929244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:44.929844 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:45.003704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:45.196935 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d75eacf9-c680-4f26-9d40-6340012cfa6c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "POST /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281342 Jun 06 12:13:45.202213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 447/921] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:13:44 2022] POST /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:45.829966 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:45.830578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:45.837497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:45.837986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:45.838713 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:45.839183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:45.853128 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 HTTP/1.1 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:13:45.854867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:45.856578 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '07fca81c-28df-4c59-8a0f-73f0ca291fb3'} Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:45.857447 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:45.859029 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:45.860700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:45.860700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-11334892-7cbe-475f-a621-3a7cc893d2e1 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 404 len: 111 microversion: 2.1 time: 0.030415 Jun 06 12:13:45.860700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 475/922] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:45 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:13:45.868244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-64cebddd-bd04-4bbc-9aab-9f703feec291 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '.version_select at 0x7fc16807b430>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:45.886179 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-64cebddd-bd04-4bbc-9aab-9f703feec291 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634701409" status: 202 len: 0 microversion: 2.1 time: 0.023218 Jun 06 12:13:45.886547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 448/923] 10.222.0.41 () {58 vars in 1220 bytes} [Mon Jun 6 12:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1634701409 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:13:53.199158 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:53.200255 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:53.207110 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.207557 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.208310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.208739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.213327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:53.224559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 HTTP/1.1 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:13:53.227153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.228908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '07fca81c-28df-4c59-8a0f-73f0ca291fb3'} Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:53.230139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.231660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.233504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:53.233504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-26d5e843-adc2-4b1a-b6a6-cd7305e9343e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 404 len: 111 microversion: 2.1 time: 0.035044 Jun 06 12:13:53.233504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 476/924] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:13:53 2022] DELETE /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:13:53.238016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:53.238752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 07fca81c-28df-4c59-8a0f-73f0ca291fb3] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:53.240672 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:13:53.247365 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.247814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.248583 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.249012 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.265034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 HTTP/1.1 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:13:53.266696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.268274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '07fca81c-28df-4c59-8a0f-73f0ca291fb3'} Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:53.269105 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. Jun 06 12:13:53.270343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:13:53.271492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 07fca81c-28df-4c59-8a0f-73f0ca291fb3 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:53.271492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3475bfd0-a60f-4397-995e-b098e8f76862 tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3" status: 404 len: 111 microversion: 2.1 time: 0.034584 Jun 06 12:13:53.271492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 449/925] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:53 2022] GET /compute/v2.1/servers/07fca81c-28df-4c59-8a0f-73f0ca291fb3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:13:53.858279 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:53.858782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:53.865637 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.866111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.866971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:53.867664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:53.948708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lazy-loading 'services' on Instance uuid 76c3c40c-4b64-469a-b62f-0ce6159522fc {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:13:54.024095 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-fd0061aa-f1b3-4402-9e6a-ede8109cb6a3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments/6c428ef6-e548-48ff-a3f3-c81b68003e28" status: 202 len: 0 microversion: 2.1 time: 0.169869 Jun 06 12:13:54.024877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 477/926] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:13:53 2022] DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments/6c428ef6-e548-48ff-a3f3-c81b68003e28 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:13:54.033978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:54.035310 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:54.043695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:54.044245 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:54.045088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:54.045530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:54.078327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-94302922-94ff-4573-b36d-129431c295ca tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049159 Jun 06 12:13:54.078799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 450/927] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:54 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:55.092102 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:55.093416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:55.099668 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:55.100111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:55.100863 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:55.101298 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:55.130011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-aec4d7d9-05c5-451a-ad02-f99bd8800bcb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042920 Jun 06 12:13:55.130547 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 478/928] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:55 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:56.141271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:56.142099 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:56.148669 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:56.149303 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:56.150058 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:56.150488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:56.179019 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d3cd6d53-3de6-476a-a3c6-d3860c429c8c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041806 Jun 06 12:13:56.179660 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 451/929] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:56 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:57.191383 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:57.192249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:57.199741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:57.200180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:57.200925 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:57.201349 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:57.229336 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f9007623-2277-4242-a1dd-dc76704558a5 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Jun 06 12:13:57.229873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 479/930] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:57 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:13:58.074909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1670733374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2130326679", "security_groups": [{"name": "tempest-secgroup-smoke-692902684"}], "block_device_mapping_v2": [{"uuid": "5171bea5-384f-485c-ae99-e71b6463ac25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2"}]}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:13:58.234191 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.network.neutron [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] validate_networks() for [('b3f28b3b-2ad4-48a4-b678-e15fb35bcbe2', None, None, None, None, None)] {{(pid=117630) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:13:58.240581 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:58.241549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:58.248121 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.248576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.249345 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.250000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.282290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-250867b5-bdd0-4b3a-b15f-8b3ad20638f3 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045529 Jun 06 12:13:58.282866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 480/931] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:13:58 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 12:13:58.342207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:58.343007 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:58.349010 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.349469 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.350258 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.350673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.375734 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:13:58.458091 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d7d54438-5c16-4336-a340-9be58c6a9910 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 204 len: 0 microversion: 2.1 time: 0.119332 Jun 06 12:13:58.458688 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 481/932] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:13:58 2022] DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 12:13:58.470906 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:58.471618 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:58.478269 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.478723 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.479518 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.479953 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.879394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:13:58.888069 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9874ba02-f6c5-4371-8d43-160f3b0a1a8f tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1678 microversion: 2.1 time: 0.424270 Jun 06 12:13:58.888636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 482/933] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:58 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:13:58.892995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:58.893486 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:58.899271 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.900408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.901178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.901609 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.914659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a HTTP/1.1 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:13:58.916945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.918303 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '75ad39f5-7b1d-4a44-b425-4742770b160a'} Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:58.919207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.921221 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.923691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:58.923691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-70e767fb-b071-490a-aff1-6e8bd3b47c4e tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 404 len: 111 microversion: 2.1 time: 0.028772 Jun 06 12:13:58.923926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:13:58.923926 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image limits 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:13:58.924225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 483/934] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:13:58 2022] DELETE /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:13:58.924317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Flavor pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:13:58.924317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Image pref 0:0:0 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:13:58.924317 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.virt.hardware [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117630) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:13:58.926256 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:58.926873 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] [instance: 75ad39f5-7b1d-4a44-b425-4742770b160a] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:58.929493 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.930011 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.931514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.932025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.934664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.935136 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.935889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:58.936323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:58.949342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:13:58.950747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] HTTP exception thrown: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Request method failure captured: Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a HTTP/1.1 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0zNyIfthRQDMlkw6nBOtyoqUfnr-Ky2_NovmWbo7oip6GvK64R1cC0GcqrO1nr0SkA6XewDw2WVzjS20rO-WQ7YfHUDcFy87skxypQqhDoQ7DVSCW58fqpkDtMAvi--_zNQsIGDeX87-kS0d7r5n_MLEliAnhnjJIGk28rqgZU19E Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:13:58.952289 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_ffaf09bc77914692bb965b55af538141", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/ffaf09bc77914692bb965b55af538141"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/ffaf09bc77914692bb965b55af538141"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: ffaf09bc77914692bb965b55af538141 Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeTestJSON-567873121 Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6c904a413f6a4ba49686debac817c70d Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeTestJSON-567873121-project Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.953914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '75ad39f5-7b1d-4a44-b425-4742770b160a'} Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:13:58.954707 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. Jun 06 12:13:58.955970 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:13:58.957141 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] Returning 404 to user: Instance 75ad39f5-7b1d-4a44-b425-4742770b160a could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:13:58.957226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Getting quotas for user adb92379209e46e79de4df370183fa8a and project c80560ca253e41239020e2c008a9b3ba. Resources: {'instances', 'cores', 'ram'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:13:58.957324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c76145c4-edd3-4da0-bf1f-d4ece6e2121a tempest-AttachVolumeTestJSON-567873121 tempest-AttachVolumeTestJSON-567873121-project] 10.222.0.41 "GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jun 06 12:13:58.957324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 484/935] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:58 2022] GET /compute/v2.1/servers/75ad39f5-7b1d-4a44-b425-4742770b160a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:13:59.016542 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Going to run 1 instances... {{(pid=117630) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:13:59.018639 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5171bea5-384f-485c-ae99-e71b6463ac25',volume_size=None,volume_type=None)] {{(pid=117630) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:13:59.151009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR oslo.messaging._drivers.impl_rabbit [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [c2dda806-d869-45ff-ae1b-c41da7207734] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 06 12:13:59.905702 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:13:59.906477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:13:59.913812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:59.914355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:13:59.915440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:13:59.915748 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:00.064931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:00.077202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4545e1ab-7d39-4297-a7aa-fb839e0d79d6 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1678 microversion: 2.1 time: 0.175374 Jun 06 12:14:00.077794 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 485/936] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:13:59 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:00.157788 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [c2dda806-d869-45ff-ae1b-c41da7207734] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 47434. Jun 06 12:14:00.162785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-981cb676-5e54-4375-9c35-31de1f70ae62 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.091929 Jun 06 12:14:00.163441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 452/937] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:13:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:14:00.173598 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4f20ce40-29d6-4117-98db-3cc3895cb77d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:00.174216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4f20ce40-29d6-4117-98db-3cc3895cb77d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:00.229296 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4f20ce40-29d6-4117-98db-3cc3895cb77d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:00.237566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4f20ce40-29d6-4117-98db-3cc3895cb77d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1095 microversion: 2.1 time: 0.067768 Jun 06 12:14:00.245715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 486/938] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:00 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:01.095876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:01.096823 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:01.105231 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:01.105689 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:01.106462 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:01.106927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:01.256956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:01.258354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:01.275404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:01.279555 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:01.280419 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:01.281438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:01.282083 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:01.290418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3d6dc3f7-0332-4f23-a3fb-0ef10f02d2cd tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1678 microversion: 2.1 time: 0.198581 Jun 06 12:14:01.301906 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 453/939] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:01 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:01.366404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:01.376569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-667b97ca-3c1d-405b-be6d-7002894373d4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1201 microversion: 2.1 time: 0.124698 Jun 06 12:14:01.377375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 487/940] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:01 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1201 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:02.309131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:02.309767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:02.316456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:02.317103 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:02.318396 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:02.319008 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:02.398171 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:02.399665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:02.410139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:02.410708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:02.411576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:02.412146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:02.437440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aebb057a324492699141a878793c097', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d38f1b5a8a43ea8677f3ce053347da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:02.448997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b25cb921-1c2d-4123-b83d-6bb205b86b6d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 200 len: 1611 microversion: 2.1 time: 0.144852 Jun 06 12:14:02.458794 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 454/941] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:02 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 1611 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:02.500596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:02.510293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-edd6a8c4-f475-4d61-ab9f-f73e9a31cfda tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1199 microversion: 2.1 time: 0.119439 Jun 06 12:14:02.522139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 488/942] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:02 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1199 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:02.670391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-911653df-e71c-48cd-9b9d-b0fe73588b5c req-19385f41-7e84-4337-ad89-7045988a1c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c3c40c-4b64-469a-b62f-0ce6159522fc", "name": "network-vif-deleted", "tag": "5f5f0542-4e21-4640-836a-cff2c187ebcf"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:02.679274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-911653df-e71c-48cd-9b9d-b0fe73588b5c req-19385f41-7e84-4337-ad89-7045988a1c61 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:02.679992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-911653df-e71c-48cd-9b9d-b0fe73588b5c req-19385f41-7e84-4337-ad89-7045988a1c61 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:02.694153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-911653df-e71c-48cd-9b9d-b0fe73588b5c req-19385f41-7e84-4337-ad89-7045988a1c61 service nova] Creating event network-vif-deleted:5f5f0542-4e21-4640-836a-cff2c187ebcf for instance 76c3c40c-4b64-469a-b62f-0ce6159522fc on hv-cinder-82549 Jun 06 12:14:02.701224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-911653df-e71c-48cd-9b9d-b0fe73588b5c req-19385f41-7e84-4337-ad89-7045988a1c61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034772 Jun 06 12:14:02.702473 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 455/943] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:03.468861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:03.470111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:03.478130 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:03.478895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:03.479835 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:03.480428 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:03.504396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc HTTP/1.1 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:03.505947 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:03.507695 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '76c3c40c-4b64-469a-b62f-0ce6159522fc'} Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:03.509430 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:03.511132 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:03.516764 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:03.517665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-be894dcd-a1e3-44bd-a682-0acff660d91b tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 404 len: 111 microversion: 2.1 time: 0.052996 Jun 06 12:14:03.518706 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 489/944] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:03 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:03.534563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-03e941bc-9314-4172-8f44-d524dcb2bfe7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '.version_select at 0x7fc16834c550>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:03.565828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:03.568232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:03.579907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-03e941bc-9314-4172-8f44-d524dcb2bfe7 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256483586" status: 202 len: 0 microversion: 2.1 time: 0.054870 Jun 06 12:14:03.585885 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 456/945] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 12:14:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256483586 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:14:03.586184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:03.586770 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:03.589279 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:03.591112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:03.905092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:03.916847 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-60dc5980-629b-4a69-b046-bcf498b9a0c5 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.373435 Jun 06 12:14:03.927332 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 490/946] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:03 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:04.888424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-be556074-3285-4984-bd09-189f3b12e729 req-fcacb7e4-0b6e-4373-9141-8b51e6b6f454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d371d348-2300-4843-978b-76a2d50d2a87", "tag": "cd03940a-edbd-4ee6-93ac-c00876093d85"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:04.901761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-be556074-3285-4984-bd09-189f3b12e729 req-fcacb7e4-0b6e-4373-9141-8b51e6b6f454 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:04.902860 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-be556074-3285-4984-bd09-189f3b12e729 req-fcacb7e4-0b6e-4373-9141-8b51e6b6f454 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:04.926997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-be556074-3285-4984-bd09-189f3b12e729 req-fcacb7e4-0b6e-4373-9141-8b51e6b6f454 service nova] Creating event network-changed:cd03940a-edbd-4ee6-93ac-c00876093d85 for instance d371d348-2300-4843-978b-76a2d50d2a87 on hv-cinder-82549 Jun 06 12:14:04.933971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:04.934597 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:04.941582 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:04.942208 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:04.943205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:04.945374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-be556074-3285-4984-bd09-189f3b12e729 req-fcacb7e4-0b6e-4373-9141-8b51e6b6f454 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062474 Jun 06 12:14:04.946611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:04.947247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 457/947] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:05.120900 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:05.129538 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1d7e33a6-8b33-4f8e-8d24-9447097cbdeb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.199929 Jun 06 12:14:05.130118 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 491/948] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:04 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:05.151855 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d8ae1083-42ed-4368-9165-c3130c2ff394 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Action: 'create', calling method: .version_select at 0x7fc16807b430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1562378543", "metadata": {"Type": "work"}}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d8ae1083-42ed-4368-9165-c3130c2ff394 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 122 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:05.163400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1562378543", "metadata": {"Type": "work"}}} Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: Jun 06 12:14:05.165325 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1562378543', 'metadata': {'Type': 'work'}}}} Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise error Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.166307 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 12:14:05.167735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 12:14:05.168948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 12:14:05.168948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.168948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d8ae1083-42ed-4368-9165-c3130c2ff394 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.168948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d8ae1083-42ed-4368-9165-c3130c2ff394 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.175818 Jun 06 12:14:05.168948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 458/949] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 12:14:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 12:14:05.174949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5af74f9-73cc-4902-b9ef-9889a263e38a tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Action: 'create', calling method: .version_select at 0x7fc15bf5fe50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1070372839", "metadata": {"Type": "work"}}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5af74f9-73cc-4902-b9ef-9889a263e38a tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 120 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:05.178225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1070372839", "metadata": {"Type": "work"}}} Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:05.179917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1070372839', 'metadata': {'Type': 'work'}}}} Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise error Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi '0' Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.181201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 12:14:05.182790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 12:14:05.184192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 12:14:05.184192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.184192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e5af74f9-73cc-4902-b9ef-9889a263e38a tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.184192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e5af74f9-73cc-4902-b9ef-9889a263e38a tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009658 Jun 06 12:14:05.184192 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 492/950] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 12:14:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:14:05.190440 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-38237d11-54ba-4141-bee3-cd58e29abeb4 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Action: 'create', calling method: .version_select at 0x7fc1680995e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1166702788", "metadata": {"Type": "work"}}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-38237d11-54ba-4141-bee3-cd58e29abeb4 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 119 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:05.192769 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1166702788", "metadata": {"Type": "work"}}} Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: Jun 06 12:14:05.194361 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1166702788', 'metadata': {'Type': 'work'}}}} Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise error Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi '' Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.195274 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 12:14:05.197324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 12:14:05.198540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 12:14:05.198540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.198540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-38237d11-54ba-4141-bee3-cd58e29abeb4 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.198540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-38237d11-54ba-4141-bee3-cd58e29abeb4 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007657 Jun 06 12:14:05.198540 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 459/951] 10.222.0.41 () {60 vars in 1155 bytes} [Mon Jun 6 12:14:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 12:14:05.204830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-29126e3e-2355-46cb-9d8b-f2df49742d89 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Calling method '.version_select at 0x7fc15bea1940>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:05.237596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-29126e3e-2355-46cb-9d8b-f2df49742d89 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] HTTP exception thrown: Volume tempest-invalid-1224695999 could not be found. Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-29126e3e-2355-46cb-9d8b-f2df49742d89 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1224695999 HTTP/1.1 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:05.240531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Volume tempest-invalid-1224695999 could not be found. Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'tempest-invalid-1224695999'} Jun 06 12:14:05.241895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1224695999 could not be found. (HTTP 404) (Request-ID: req-5c468d40-47de-434b-afce-7eb0a31feac9) Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.242736 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:05.244000 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1224695999 could not be found. Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:05.245216 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1224695999 could not be found. Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1224695999 could not be found. Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-29126e3e-2355-46cb-9d8b-f2df49742d89 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 404 to user: Volume tempest-invalid-1224695999 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-29126e3e-2355-46cb-9d8b-f2df49742d89 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1224695999" status: 404 len: 99 microversion: 2.1 time: 0.041324 Jun 06 12:14:05.246425 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 493/952] 10.222.0.41 () {58 vars in 1217 bytes} [Mon Jun 6 12:14:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1224695999 => generated 99 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 06 12:14:05.253594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-891f5c90-c2a9-4653-bfac-d858036520c3 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004649 Jun 06 12:14:05.254370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 460/953] 10.222.0.41 () {58 vars in 1139 bytes} [Mon Jun 6 12:14:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 06 12:14:05.264386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-76267fa6-f1bd-4835-8468-697b43f4018c tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004550 Jun 06 12:14:05.265096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 494/954] 10.222.0.41 () {58 vars in 1136 bytes} [Mon Jun 6 12:14:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 12:14:05.273708 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e5583a2-f2bd-4d26-8049-d98e9ff7c4c2 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Calling method '.version_select at 0x7fc168383c10>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:05.302967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-5e5583a2-f2bd-4d26-8049-d98e9ff7c4c2 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] HTTP exception thrown: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e5583a2-f2bd-4d26-8049-d98e9ff7c4c2 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/os-volumes/3322ce8b-2623-4e47-b859-c1ade935858d HTTP/1.1 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:05.306127 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '3322ce8b-2623-4e47-b859-c1ade935858d'} Jun 06 12:14:05.307876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. (HTTP 404) (Request-ID: req-2ebbf817-fe42-434b-843f-8da7c123ba5d) Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.309185 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:05.310675 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 12:14:05.312713 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e5583a2-f2bd-4d26-8049-d98e9ff7c4c2 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 404 to user: Volume 3322ce8b-2623-4e47-b859-c1ade935858d could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e5583a2-f2bd-4d26-8049-d98e9ff7c4c2 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/3322ce8b-2623-4e47-b859-c1ade935858d" status: 404 len: 109 microversion: 2.1 time: 0.037607 Jun 06 12:14:05.314153 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 461/955] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:14:05 2022] DELETE /compute/v2.1/os-volumes/3322ce8b-2623-4e47-b859-c1ade935858d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:14:05.318708 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9f3f6c03-f1ad-4f23-9b9b-47f235e7ff50 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Calling method '.version_select at 0x7fc1680c2b80>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:05.349971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-9f3f6c03-f1ad-4f23-9b9b-47f235e7ff50 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] HTTP exception thrown: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9f3f6c03-f1ad-4f23-9b9b-47f235e7ff50 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Request method failure captured: Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/a9e63c42-f653-481a-94a3-45244309bd1b HTTP/1.1 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-MuOFDsQHP7BT1T8tCp8kPuw7QTXDnpgd3dhYhJSNC9jcs828U9rDWM1rc77avBKmqCuKNSUNL1FBP-jIow8k4LDHDQdt4D3jIdlhbELycs-4sGcmTpROYQ3NIgho9qKU489XqOYxPSstf52mLlXBLbuxlb1ydxPffGlp5jxaOlAo Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:05.352760 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_67b0ce27c73a4530a3b250590698e515", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/67b0ce27c73a4530a3b250590698e515"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 67b0ce27c73a4530a3b250590698e515 Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesNegativeTest-407505607 Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: ff9ac774ade44e97bf942c25b953d9ce Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesNegativeTest-407505607-project Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'a9e63c42-f653-481a-94a3-45244309bd1b'} Jun 06 12:14:05.354410 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. (HTTP 404) (Request-ID: req-7845599b-552f-4d5a-a529-1bfa940390ce) Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.355431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:05.356902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 12:14:05.358639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9f3f6c03-f1ad-4f23-9b9b-47f235e7ff50 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] Returning 404 to user: Volume a9e63c42-f653-481a-94a3-45244309bd1b could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:05.360199 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9f3f6c03-f1ad-4f23-9b9b-47f235e7ff50 tempest-VolumesNegativeTest-407505607 tempest-VolumesNegativeTest-407505607-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/a9e63c42-f653-481a-94a3-45244309bd1b" status: 404 len: 109 microversion: 2.1 time: 0.040549 Jun 06 12:14:05.366280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 495/956] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:05 2022] GET /compute/v2.1/os-volumes/a9e63c42-f653-481a-94a3-45244309bd1b => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:06.040799 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:06.041555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:06.049031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.049486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.050258 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.050715 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.064254 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc HTTP/1.1 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:06.065819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.067218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '76c3c40c-4b64-469a-b62f-0ce6159522fc'} Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:06.068626 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.070126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.072658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:06.072658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-990bb2aa-60e4-432e-9b22-fccff0ea038c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 404 len: 111 microversion: 2.1 time: 0.030715 Jun 06 12:14:06.072658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 462/957] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:14:06 2022] DELETE /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:06.077324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:06.078066 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 76c3c40c-4b64-469a-b62f-0ce6159522fc] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:06.084174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.084646 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.085385 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.085821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.100741 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc HTTP/1.1 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:06.102217 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.103762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '76c3c40c-4b64-469a-b62f-0ce6159522fc'} Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:06.104726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. Jun 06 12:14:06.106334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:06.108502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 76c3c40c-4b64-469a-b62f-0ce6159522fc could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:06.108502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0f413f0d-d182-4ae3-9cf8-a79855b03ceb tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc" status: 404 len: 111 microversion: 2.1 time: 0.031260 Jun 06 12:14:06.108502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 496/958] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:06 2022] GET /compute/v2.1/servers/76c3c40c-4b64-469a-b62f-0ce6159522fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:06.148214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:06.149120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:06.155738 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.156429 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.157201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:06.157640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:06.311745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:06.319205 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f9abfe63-7aa4-4c53-b73a-bcaf1994ed92 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.175070 Jun 06 12:14:06.319760 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 463/959] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:06 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:07.246414 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:07.246932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:07.249293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:07.254603 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.255080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.255838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.256267 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.271119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 HTTP/1.1 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:07.272671 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.274415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'f2882d4e-8691-4d0b-abf9-7fd49d8802c2'} Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:07.275424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.276967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.278523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:07.278523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-877896f9-2406-4c2b-aef1-6ea1781501ef tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 404 len: 111 microversion: 2.1 time: 0.032424 Jun 06 12:14:07.278523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 497/960] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:14:07 2022] DELETE /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:07.283779 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:07.284403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: f2882d4e-8691-4d0b-abf9-7fd49d8802c2] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:07.291909 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.292362 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.293126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.293563 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.307415 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 HTTP/1.1 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:07.308940 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.310550 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'f2882d4e-8691-4d0b-abf9-7fd49d8802c2'} Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:07.311460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. Jun 06 12:14:07.312888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.314169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance f2882d4e-8691-4d0b-abf9-7fd49d8802c2 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:07.314169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-392ba83f-e6b3-4e42-b190-e71d31b1c211 tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2" status: 404 len: 111 microversion: 2.1 time: 0.030354 Jun 06 12:14:07.314169 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 464/961] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:07 2022] GET /compute/v2.1/servers/f2882d4e-8691-4d0b-abf9-7fd49d8802c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:07.318747 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:07.319268 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:07.325709 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.326152 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.326934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.327367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.337159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:07.337902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:07.341688 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c HTTP/1.1 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:07.343520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.345404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '350245e3-005d-45bf-92e0-788b04a2416c'} Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:07.346408 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.348197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.350197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:07.350197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f2874df6-d8cd-4b3b-b7e6-c3a24001567c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 404 len: 111 microversion: 2.1 time: 0.029985 Jun 06 12:14:07.350197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 498/962] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:14:07 2022] DELETE /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:14:07.350445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.350445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.350445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.350445 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.356419 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:07.356766 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: 350245e3-005d-45bf-92e0-788b04a2416c] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:07.363418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.363977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.364856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:07.365392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:07.381301 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c HTTP/1.1 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:07.383331 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.384684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '350245e3-005d-45bf-92e0-788b04a2416c'} Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:07.385523 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. Jun 06 12:14:07.386750 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:07.387960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance 350245e3-005d-45bf-92e0-788b04a2416c could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:07.387960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-bd68255e-5568-4210-a083-48a2ebcc992d tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c" status: 404 len: 111 microversion: 2.1 time: 0.033769 Jun 06 12:14:07.387960 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 499/963] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:07 2022] GET /compute/v2.1/servers/350245e3-005d-45bf-92e0-788b04a2416c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:07.510157 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:07.518300 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4aa8434c-2ed9-4cad-b5b7-9743e2404ce6 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.185567 Jun 06 12:14:07.518904 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 465/964] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:07 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:14:08.535639 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:08.536276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:08.536939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:08.537444 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:08.543838 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.544290 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.544608 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.545056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.545155 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.545495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.545819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.546255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.559785 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 HTTP/1.1 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:08.561504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.563137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'c3895721-6514-401d-aa5d-b36908cf8708'} Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:08.564027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.565345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.566602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:08.566602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-90399672-af2d-4a80-8fbe-76cab662231a tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 404 len: 111 microversion: 2.1 time: 0.030624 Jun 06 12:14:08.566602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 466/965] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:14:08 2022] DELETE /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:14:08.572108 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:08.572722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] [instance: c3895721-6514-401d-aa5d-b36908cf8708] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:08.578703 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.579176 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.579944 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:08.580379 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:08.595196 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] HTTP exception thrown: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Request method failure captured: Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 HTTP/1.1 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine0wp5RetPN0BGboDrnEYiQebA4AWXGxfZTJ39aOus3WRkL5aZ0Aso6xFuzPNNp5MP9GGWCc8x7wfIT9f_ZgIV6a8KyZIYLB03U5iFUJYKFHITLvGek8T_ha8tRhsKeeMmK27Zi7NwDzLYrHYaGMDyC2TjynIWVZXwvip6bVk1MWZU8 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:08.596727 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b7d38f1b5a8a43ea8677f3ce053347da", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b7d38f1b5a8a43ea8677f3ce053347da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b7d38f1b5a8a43ea8677f3ce053347da Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197961018 Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 6aebb057a324492699141a878793c097 Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeNegativeTest-1197961018-project Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.598329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'c3895721-6514-401d-aa5d-b36908cf8708'} Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:08.599251 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. Jun 06 12:14:08.600707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:08.602056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] Returning 404 to user: Instance c3895721-6514-401d-aa5d-b36908cf8708 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:08.602056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-84c974a8-09bd-419f-9b16-24676d6fbf5c tempest-AttachVolumeNegativeTest-1197961018 tempest-AttachVolumeNegativeTest-1197961018-project] 10.222.0.41 "GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708" status: 404 len: 111 microversion: 2.1 time: 0.029755 Jun 06 12:14:08.602056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 467/966] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:08 2022] GET /compute/v2.1/servers/c3895721-6514-401d-aa5d-b36908cf8708 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:14:08.688391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:08.690434 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:08.697363 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-00e2c5af-54a3-4766-a201-5f51d8af3297 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.165510 Jun 06 12:14:08.704715 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 500/967] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:08 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:09.713728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:09.714368 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:09.716329 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:09.717096 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:09.724481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:09.724925 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:09.725688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:09.726151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:09.867218 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:09.875674 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e644cbbb-a669-465c-96f1-bc70e9baf047 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.166013 Jun 06 12:14:09.876249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 468/968] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:09 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:10.893649 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:10.894418 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:10.899458 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:10.904923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:10.905564 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:10.906431 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:10.907071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:11.057594 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:11.070089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9e164cbd-feb0-4c6a-8bca-2c77040e7b9a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.180259 Jun 06 12:14:11.070676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 501/969] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:10 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:12.087956 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:12.089368 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:12.098286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:12.099140 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:12.099924 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:12.100391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:12.247295 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:12.254747 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd017e2e-3bbe-4601-b6a6-e53102b8935c tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.170904 Jun 06 12:14:12.255475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 469/970] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:12 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:13.219622 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6a732165-06e4-420c-8642-0c937dc9f23a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Action: 'create', calling method: .version_select at 0x7fc15be5a820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-368271671"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:13.272070 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:13.272660 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:13.280972 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:13.281426 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:13.282201 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:13.282640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:13.418569 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:13.426240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-1b076a6f-a71b-4209-96ea-619b88dd980e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.158264 Jun 06 12:14:13.426817 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 470/971] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:13 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:14:13.514142 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6a732165-06e4-420c-8642-0c937dc9f23a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.424662 Jun 06 12:14:13.515031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 502/972] 10.222.0.41 () {60 vars in 1154 bytes} [Mon Jun 6 12:14:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 12:14:13.526037 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-bdf39c99-f112-4215-8786-105989e5a17c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16826a0d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:13.577822 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-bdf39c99-f112-4215-8786-105989e5a17c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 200 len: 344 microversion: 2.1 time: 0.055811 Jun 06 12:14:13.578413 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 471/973] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:13 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:14.444889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:14.445504 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:14.453352 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:14.453800 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:14.454559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:14.455036 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:14.587077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:14.591428 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-953dedfa-60cd-45be-853a-a71f7b936c3c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16834c670>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:14.594956 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d2d743a8-78a6-4ef5-8aa9-cd72e775696a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.154479 Jun 06 12:14:14.595524 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 503/974] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:14 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:14.639215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-953dedfa-60cd-45be-853a-a71f7b936c3c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 200 len: 344 microversion: 2.1 time: 0.052467 Jun 06 12:14:14.639781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 472/975] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:14 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:15.612059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:15.612667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:15.619461 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:15.619909 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:15.620659 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:15.621089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:15.652802 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7d350be3-c62e-40cf-af96-6cc52be64cab tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16813a8b0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:15.699271 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7d350be3-c62e-40cf-af96-6cc52be64cab tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 200 len: 344 microversion: 2.1 time: 0.051352 Jun 06 12:14:15.700126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 473/976] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:15 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:15.752096 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:15.760200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c66c862e-c0ae-4842-a748-000bf685f3a7 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.151992 Jun 06 12:14:15.760772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 504/977] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:15 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:16.711963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fd4fb03b-0077-4f6e-ba81-66c5f7743738 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16826a9d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:16.757879 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fd4fb03b-0077-4f6e-ba81-66c5f7743738 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 200 len: 345 microversion: 2.1 time: 0.050273 Jun 06 12:14:16.758443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 474/978] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:16 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:16.769223 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-615b3baf-9bfb-4803-992c-ecee26ec98c5 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Action: 'create', calling method: .version_select at 0x7fc15be7a040>, body: {"snapshot": {"volume_id": "91a6e2b5-25f8-48f4-b119-a1f232ef1478", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-133511188"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:16.779977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:16.780607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:16.787102 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:16.787561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:16.788344 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:16.788782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:16.794696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:16.938746 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:16.946731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7bb20408-0db9-4829-9622-95f76b41db8a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.172629 Jun 06 12:14:16.957571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 475/979] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:16 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:16.965133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-615b3baf-9bfb-4803-992c-ecee26ec98c5 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.199512 Jun 06 12:14:16.965890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 505/980] 10.222.0.41 () {60 vars in 1161 bytes} [Mon Jun 6 12:14:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:16.976456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-58b7e141-169c-489b-80ee-c27af654be7a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16809f670>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:17.008413 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-58b7e141-169c-489b-80ee-c27af654be7a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.036178 Jun 06 12:14:17.008899 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 476/981] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:16 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:17.019067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-df12b486-81bf-458d-a1e9-e3b5834077a6 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc15bf16040>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:17.049857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-df12b486-81bf-458d-a1e9-e3b5834077a6 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034871 Jun 06 12:14:17.050426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 506/982] 10.222.0.41 () {58 vars in 1139 bytes} [Mon Jun 6 12:14:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:17.061370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f583d171-f33c-425b-a781-f6991066d923 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16834c3a0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:17.090787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f583d171-f33c-425b-a781-f6991066d923 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.034371 Jun 06 12:14:17.091403 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 477/983] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:17 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:17.965251 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:17.966479 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:17.972868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:17.973318 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:17.974085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:17.974526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:18.103259 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3d41e557-d246-4f22-8b98-52f271993bb4 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16813aa60>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:18.105278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:18.113063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e3b1272-bb63-471d-9288-ba1bfb66e31e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.152282 Jun 06 12:14:18.113632 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 507/984] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:17 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:18.134194 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3d41e557-d246-4f22-8b98-52f271993bb4 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.035208 Jun 06 12:14:18.135439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 478/985] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:18 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:19.130614 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:19.131235 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:19.137788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:19.138236 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:19.139030 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:19.139464 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:19.145721 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b8a9e762-07d8-444e-8ed3-b14c22fb934a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16804d310>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:19.175652 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b8a9e762-07d8-444e-8ed3-b14c22fb934a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.034106 Jun 06 12:14:19.176226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 479/986] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:19 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:14:19.272630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:19.280610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-99cca9ca-c877-4742-b9c2-18ccc4d8a3b8 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.153907 Jun 06 12:14:19.281181 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 508/987] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:19 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:20.188505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b20528d8-e144-46f5-b28b-74ab46c6c9c5 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16834c4c0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:20.216743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b20528d8-e144-46f5-b28b-74ab46c6c9c5 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.032663 Jun 06 12:14:20.217286 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 480/988] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:20 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:20.297986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:20.298592 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:20.305077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:20.305520 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:20.306267 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:20.307468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:20.437844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:20.445224 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1c6f69e7-7728-43aa-a575-1d0c10ad02a2 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.151038 Jun 06 12:14:20.445779 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 509/989] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:20 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:21.229387 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3b1a4681-181c-47f1-a8db-e08a57b05023 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc1682bf9d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:21.261859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3b1a4681-181c-47f1-a8db-e08a57b05023 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.037048 Jun 06 12:14:21.262422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 481/990] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:21 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:21.462897 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:21.463640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:21.470245 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:21.470697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:21.471487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:21.471929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:21.601832 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:21.610854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3b853575-dbd4-4c46-8bd2-14ad159ee8e1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.151906 Jun 06 12:14:21.611570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 510/991] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:21 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:22.274060 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d156427f-1dbe-4f45-b3f5-cbf3a8b77b22 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16834cee0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:22.303643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d156427f-1dbe-4f45-b3f5-cbf3a8b77b22 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 287 microversion: 2.1 time: 0.033839 Jun 06 12:14:22.304206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 482/992] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:22 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:22.314811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-28cface7-e890-43ab-8e5a-6f5e8610eff4 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc15bea1820>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:22.372985 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-28cface7-e890-43ab-8e5a-6f5e8610eff4 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 202 len: 0 microversion: 2.1 time: 0.061882 Jun 06 12:14:22.373558 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 511/993] 10.222.0.41 () {58 vars in 1253 bytes} [Mon Jun 6 12:14:22 2022] DELETE /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:14:22.381553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-39805ac6-e2ce-438e-9223-1aa2f555933d tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16826a790>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:22.410957 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-39805ac6-e2ce-438e-9223-1aa2f555933d tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 200 len: 286 microversion: 2.1 time: 0.033090 Jun 06 12:14:22.411506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 483/994] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:22 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:22.628367 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:22.628986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:22.635119 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:22.635568 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:22.636337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:22.636775 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:22.769903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:22.778186 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8da1506e-4398-4f6e-a2b3-c48bc7aef4aa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.154146 Jun 06 12:14:22.778754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 512/995] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:22 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:22.975226 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-5ea2a402-06dd-4986-ac87-9e24f333e839 req-478b47b4-047a-4d38-8894-e666734b7387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d371d348-2300-4843-978b-76a2d50d2a87", "name": "network-vif-plugged", "status": "completed", "tag": "cd03940a-edbd-4ee6-93ac-c00876093d85"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:22.985822 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5ea2a402-06dd-4986-ac87-9e24f333e839 req-478b47b4-047a-4d38-8894-e666734b7387 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:22.986345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5ea2a402-06dd-4986-ac87-9e24f333e839 req-478b47b4-047a-4d38-8894-e666734b7387 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:22.997962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-5ea2a402-06dd-4986-ac87-9e24f333e839 req-478b47b4-047a-4d38-8894-e666734b7387 service nova] Creating event network-vif-plugged:cd03940a-edbd-4ee6-93ac-c00876093d85 for instance d371d348-2300-4843-978b-76a2d50d2a87 on hv-cinder-82549 Jun 06 12:14:23.003261 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-5ea2a402-06dd-4986-ac87-9e24f333e839 req-478b47b4-047a-4d38-8894-e666734b7387 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031767 Jun 06 12:14:23.004512 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 484/996] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:23.423453 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c7c7412a-2399-4244-aa88-bafc04fcac9c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc1680fb160>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:23.448045 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-c7c7412a-2399-4244-aa88-bafc04fcac9c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] HTTP exception thrown: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c7c7412a-2399-4244-aa88-bafc04fcac9c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Request method failure captured: Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 HTTP/1.1 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-VGgPLa9_0UMHZR6zSlVIGUwL-Xsa67ym4mcnG1tTtMa7yEcg6PElvJPeRRFndmSzBdVf1ezVuYkf6NDNjafD7Dy_wn-xpEy8cGJCKLzwm7FmmYscxbqQ2tD2LJGpVqjCTW6gwzD-Z6ow4mIq9hHwQmFX8toxqVerCX1ulGy1nqC8 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:23.450988 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b741f6cd02d24da2ab07ebb511fcb381", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 94c4597335154001bcc0bfd2bae15c95 Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '43d320ed-0d70-4be9-8573-d6879a031160'} Jun 06 12:14:23.452788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. (HTTP 404) (Request-ID: req-95e7a395-007b-4665-a787-950bdde4c9d6) Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.453836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:23.455356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 12:14:23.457090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c7c7412a-2399-4244-aa88-bafc04fcac9c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Returning 404 to user: Snapshot 43d320ed-0d70-4be9-8573-d6879a031160 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:23.458599 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c7c7412a-2399-4244-aa88-bafc04fcac9c tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160" status: 404 len: 111 microversion: 2.1 time: 0.033423 Jun 06 12:14:23.459645 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 513/997] 10.222.0.41 () {58 vars in 1250 bytes} [Mon Jun 6 12:14:23 2022] GET /compute/v2.1/os-snapshots/43d320ed-0d70-4be9-8573-d6879a031160 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:23.461975 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a85f77a8-ebdd-4e14-ba43-e86c804e0a12 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc16826a9d0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:23.522497 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a85f77a8-ebdd-4e14-ba43-e86c804e0a12 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 202 len: 0 microversion: 2.1 time: 0.065032 Jun 06 12:14:23.523117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 485/998] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:14:23 2022] DELETE /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:14:23.531380 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9c4915d6-a9ee-4fba-9ac7-ee94a30753fb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc15be8bc10>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:23.580488 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9c4915d6-a9ee-4fba-9ac7-ee94a30753fb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 200 len: 344 microversion: 2.1 time: 0.052953 Jun 06 12:14:23.581047 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 514/999] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:23 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:23.795481 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:23.796213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:23.802287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:23.802734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:23.803519 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:23.803954 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:23.944280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:23.952229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9c4f0677-93ee-43ba-9804-5b2fce15e00d tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.161199 Jun 06 12:14:23.952805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 486/1000] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:23 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:24.594285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dac3f55e-0e55-4118-9164-735a74b1e6eb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc1680fbb80>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:24.633105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-dac3f55e-0e55-4118-9164-735a74b1e6eb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] HTTP exception thrown: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dac3f55e-0e55-4118-9164-735a74b1e6eb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Request method failure captured: Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 HTTP/1.1 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-VGgPLa9_0UMHZR6zSlVIGUwL-Xsa67ym4mcnG1tTtMa7yEcg6PElvJPeRRFndmSzBdVf1ezVuYkf6NDNjafD7Dy_wn-xpEy8cGJCKLzwm7FmmYscxbqQ2tD2LJGpVqjCTW6gwzD-Z6ow4mIq9hHwQmFX8toxqVerCX1ulGy1nqC8 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:24.635357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b741f6cd02d24da2ab07ebb511fcb381", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 94c4597335154001bcc0bfd2bae15c95 Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '91a6e2b5-25f8-48f4-b119-a1f232ef1478'} Jun 06 12:14:24.636687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. (HTTP 404) (Request-ID: req-be5fbba7-b377-4e6f-b020-184553119cff) Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.637545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:24.638898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 12:14:24.640324 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-dac3f55e-0e55-4118-9164-735a74b1e6eb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Returning 404 to user: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-dac3f55e-0e55-4118-9164-735a74b1e6eb tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 404 len: 109 microversion: 2.1 time: 0.047966 Jun 06 12:14:24.641829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 515/1001] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:24 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:24.651729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-259fdf9a-ab07-46b2-a55e-388eff6e19b0 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc1680fad30>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:24.680151 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-259fdf9a-ab07-46b2-a55e-388eff6e19b0 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] HTTP exception thrown: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-259fdf9a-ab07-46b2-a55e-388eff6e19b0 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Request method failure captured: Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 HTTP/1.1 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine-VGgPLa9_0UMHZR6zSlVIGUwL-Xsa67ym4mcnG1tTtMa7yEcg6PElvJPeRRFndmSzBdVf1ezVuYkf6NDNjafD7Dy_wn-xpEy8cGJCKLzwm7FmmYscxbqQ2tD2LJGpVqjCTW6gwzD-Z6ow4mIq9hHwQmFX8toxqVerCX1ulGy1nqC8 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:14:24.682217 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b741f6cd02d24da2ab07ebb511fcb381", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 94c4597335154001bcc0bfd2bae15c95 Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '91a6e2b5-25f8-48f4-b119-a1f232ef1478'} Jun 06 12:14:24.687804 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. (HTTP 404) (Request-ID: req-a84f36f0-ec7e-40be-a60e-90b3ee6ca363) Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.688849 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 12:14:24.690255 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 12:14:24.691643 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-259fdf9a-ab07-46b2-a55e-388eff6e19b0 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Returning 404 to user: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:24.693041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-259fdf9a-ab07-46b2-a55e-388eff6e19b0 tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 404 len: 109 microversion: 2.1 time: 0.036325 Jun 06 12:14:24.693999 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 487/1002] 10.222.0.41 () {58 vars in 1247 bytes} [Mon Jun 6 12:14:24 2022] DELETE /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:24.694089 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-56964852-3380-4f0e-af83-df3c76150a9a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Calling method '.version_select at 0x7fc15bf3b790>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:24.722311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-56964852-3380-4f0e-af83-df3c76150a9a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] HTTP exception thrown: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-56964852-3380-4f0e-af83-df3c76150a9a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Request method failure captured: Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 HTTP/1.1 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine-VGgPLa9_0UMHZR6zSlVIGUwL-Xsa67ym4mcnG1tTtMa7yEcg6PElvJPeRRFndmSzBdVf1ezVuYkf6NDNjafD7Dy_wn-xpEy8cGJCKLzwm7FmmYscxbqQ2tD2LJGpVqjCTW6gwzD-Z6ow4mIq9hHwQmFX8toxqVerCX1ulGy1nqC8 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:14:24.724308 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_b741f6cd02d24da2ab07ebb511fcb381", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/b741f6cd02d24da2ab07ebb511fcb381"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: b741f6cd02d24da2ab07ebb511fcb381 Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500822891 Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 94c4597335154001bcc0bfd2bae15c95 Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500822891-project Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '91a6e2b5-25f8-48f4-b119-a1f232ef1478'} Jun 06 12:14:24.725921 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. (HTTP 404) (Request-ID: req-5975ed27-55b4-4697-9915-91ebb702dc3d) Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.726937 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 12:14:24.728286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 12:14:24.729676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-56964852-3380-4f0e-af83-df3c76150a9a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] Returning 404 to user: Volume 91a6e2b5-25f8-48f4-b119-a1f232ef1478 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-56964852-3380-4f0e-af83-df3c76150a9a tempest-VolumesSnapshotsTestJSON-1500822891 tempest-VolumesSnapshotsTestJSON-1500822891-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478" status: 404 len: 109 microversion: 2.1 time: 0.036710 Jun 06 12:14:24.731661 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 516/1003] 10.222.0.41 () {58 vars in 1244 bytes} [Mon Jun 6 12:14:24 2022] GET /compute/v2.1/os-volumes/91a6e2b5-25f8-48f4-b119-a1f232ef1478 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:14:24.969132 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:24.970012 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:24.975839 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:24.982049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:24.982318 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:24.983324 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:24.983776 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:25.227532 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:25.236306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9322822a-943d-4e92-9ab8-209b7b9496a1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1266 microversion: 2.1 time: 0.271217 Jun 06 12:14:25.237168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 488/1004] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:24 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:26.256854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:26.257515 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:26.265234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:26.266512 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:26.267533 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:26.268495 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:26.420080 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:26.428196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-357ec8ee-3fa1-4ea4-b36f-218dccf908a3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1453 microversion: 2.1 time: 0.175470 Jun 06 12:14:26.428836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 517/1005] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:26 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:26.446110 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:26.446870 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:26.472704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:26.473236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:26.474161 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:26.474731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:26.643451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:26.653898 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-75abe517-1018-4a7c-8b31-ee0c6f17293a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1453 microversion: 2.1 time: 0.212329 Jun 06 12:14:26.654984 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 489/1006] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:14:26 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:28.943319 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-ad31d31e-b702-4e45-9e5b-353dcc228301 req-c05dccdf-bdde-4a94-b76f-1b53b8f08fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d371d348-2300-4843-978b-76a2d50d2a87", "tag": "cd03940a-edbd-4ee6-93ac-c00876093d85"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:28.956391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ad31d31e-b702-4e45-9e5b-353dcc228301 req-c05dccdf-bdde-4a94-b76f-1b53b8f08fe0 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:28.956930 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-ad31d31e-b702-4e45-9e5b-353dcc228301 req-c05dccdf-bdde-4a94-b76f-1b53b8f08fe0 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:28.972905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-ad31d31e-b702-4e45-9e5b-353dcc228301 req-c05dccdf-bdde-4a94-b76f-1b53b8f08fe0 service nova] Creating event network-changed:cd03940a-edbd-4ee6-93ac-c00876093d85 for instance d371d348-2300-4843-978b-76a2d50d2a87 on hv-cinder-82549 Jun 06 12:14:28.978357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-ad31d31e-b702-4e45-9e5b-353dcc228301 req-c05dccdf-bdde-4a94-b76f-1b53b8f08fe0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038991 Jun 06 12:14:28.980261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 518/1007] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:53.462064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:53.463109 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:53.466020 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:53.466687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=25 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:53.473054 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.473505 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.474280 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.474720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.505587 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a90922d9-05cd-47f2-a447-ef55b7c6e99f tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048200 Jun 06 12:14:53.506159 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 490/1008] 10.222.0.41 () {60 vars in 1342 bytes} [Mon Jun 6 12:14:53 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:14:53.566925 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:53.567686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:53.569976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=27 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:53.570752 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=57 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:14:53.578237 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.578683 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.579470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.579905 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.609218 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:14:53.690123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-84a6176f-e6b7-460e-8223-3e3d21c917f3 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 204 len: 0 microversion: 2.20 time: 0.126364 Jun 06 12:14:53.690744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 519/1009] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 12:14:53 2022] DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 12:14:53.700262 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:53.700876 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:53.709745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.710360 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.711388 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:53.711945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:53.852235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:53.860791 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:53.862278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:53.863443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-80e91152-0fd9-49b7-a8d9-f72997f7378e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.167709 Jun 06 12:14:53.863994 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 491/1010] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:53 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:14:54.882291 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:54.883013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:54.892643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:54.893092 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:54.893852 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:54.894284 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:55.039184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:55.052005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:55.054019 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:55.055357 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d686e1d8-0b42-46ce-a138-653008295b9a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.177303 Jun 06 12:14:55.055917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 520/1011] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:54 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:14:56.075518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:56.076165 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:56.083272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:56.083725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:56.084759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:56.085206 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:56.246601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:56.254803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:56.256331 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:56.257492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-91a8bebc-f833-4062-a449-364b5acaa9a4 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1724 microversion: 2.20 time: 0.186678 Jun 06 12:14:56.258071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 492/1012] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:56 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:14:57.055580 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-da18c34c-db49-4783-b36d-f3ff1c79883f req-6b5eec51-08ef-4c8f-8f49-beca091774e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b16ad2-de00-48c9-8ebc-92cb9e533fec", "name": "network-vif-deleted", "tag": "52393178-c247-4966-8c15-82ecb89fff65"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:14:57.065662 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da18c34c-db49-4783-b36d-f3ff1c79883f req-6b5eec51-08ef-4c8f-8f49-beca091774e2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:57.066327 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-da18c34c-db49-4783-b36d-f3ff1c79883f req-6b5eec51-08ef-4c8f-8f49-beca091774e2 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:57.084174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-da18c34c-db49-4783-b36d-f3ff1c79883f req-6b5eec51-08ef-4c8f-8f49-beca091774e2 service nova] Creating event network-vif-deleted:52393178-c247-4966-8c15-82ecb89fff65 for instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec on hv-cinder-82549 Jun 06 12:14:57.089968 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-da18c34c-db49-4783-b36d-f3ff1c79883f req-6b5eec51-08ef-4c8f-8f49-beca091774e2 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.343627 Jun 06 12:14:57.090890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 521/1013] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:14:57.280551 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:57.281826 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:57.290000 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:57.290738 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:57.291813 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:57.293150 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:57.358772 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:57.366787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:57.368558 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:57.369891 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ffabe821-8ce3-4063-98c0-7024a7241d06 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1656 microversion: 2.20 time: 0.094077 Jun 06 12:14:57.371065 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 493/1014] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:57 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:14:58.688967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:58.691021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:58.698776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:58.699466 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:58.700596 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:58.701077 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:58.786818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:58.796209 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:58.797721 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:58.799049 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-9652df89-ee34-40f3-91e4-9246195534a8 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1366 microversion: 2.20 time: 0.414157 Jun 06 12:14:58.799887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 522/1015] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:58 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 12:14:59.817724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:14:59.818430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:14:59.825839 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:59.826288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:59.827086 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:14:59.827514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:14:59.921391 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:59.931756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:59.933374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c8bda0c079054e198ffeca4c0ac18bf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e76a3125df4436abf5f788e35d492f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:14:59.934705 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2423e9b9-c3c4-4724-a990-e3e0a90fdbc7 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 200 len: 1366 microversion: 2.20 time: 0.121027 Jun 06 12:14:59.935248 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 494/1016] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:14:59 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 12:15:00.953989 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:00.954536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:00.961255 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:00.961714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:00.962472 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:00.962927 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:00.977703 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec HTTP/1.1 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:15:00.979406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:00.981697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '12b16ad2-de00-48c9-8ebc-92cb9e533fec'} Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:15:00.982694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:00.984343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:00.985754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:15:00.985754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ba981372-c434-4dcf-bba2-814c333b0f4d tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 404 len: 111 microversion: 2.20 time: 0.031646 Jun 06 12:15:00.985754 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 523/1017] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:15:00 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:15:00.990658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd400d19-becd-4198-9679-55d09fd66a02 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '.version_select at 0x7fc16804d820>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:01.009085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd400d19-becd-4198-9679-55d09fd66a02 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529759032" status: 204 len: 0 microversion: 2.20 time: 0.022200 Jun 06 12:15:01.009670 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 495/1018] 10.222.0.41 () {60 vars in 1261 bytes} [Mon Jun 6 12:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1529759032 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 12:15:02.542343 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1545676151", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "networks": [{"uuid": "988e0c29-83cf-459a-ab84-02501744471e"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:15:02.596519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] validate_networks() for [('988e0c29-83cf-459a-ab84-02501744471e', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:15:03.003074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:15:03.003500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:15:03.003971 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:15:03.004407 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:15:03.004844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:15:03.015139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:03.015589 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:03.016396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:03.016830 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:03.034414 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Getting quotas for project 621a97bcf68f4dea8bce2be900c2eefd. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:15:03.038382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Getting quotas for user 8c4a7545593a45dca9c0029d29910811 and project 621a97bcf68f4dea8bce2be900c2eefd. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:15:03.049507 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:15:03.051828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:15:03.096034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4ad88c57-6ccb-498f-94c4-3f016db7782f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557580 Jun 06 12:15:03.096678 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 524/1019] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:15:03.106726 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-370e62e7-8696-4748-bbb1-43932f1ec5dc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:03.107372 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-370e62e7-8696-4748-bbb1-43932f1ec5dc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:03.162115 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-370e62e7-8696-4748-bbb1-43932f1ec5dc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:03.170143 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-370e62e7-8696-4748-bbb1-43932f1ec5dc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1219 microversion: 2.1 time: 0.067429 Jun 06 12:15:03.170722 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 496/1020] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:03 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:04.188475 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:04.189023 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:04.195322 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:04.195782 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:04.196560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:04.196999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:04.259746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:04.267320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a35a439d-5913-48ea-8408-9006f7ac32a3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1223 microversion: 2.1 time: 0.084074 Jun 06 12:15:04.267877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 525/1021] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:04 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:05.284145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:05.284691 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:05.291291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:05.291747 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:05.293003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:05.293447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:05.357814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:05.365311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c5666fe0-42e6-493f-bacb-5cc4178ea029 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1223 microversion: 2.1 time: 0.085217 Jun 06 12:15:05.365886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 497/1022] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:05 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:06.381826 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:06.382435 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:06.389084 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:06.389531 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:06.390293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:06.390726 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:06.453266 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:06.460824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7c2339b7-13bc-4ada-a8b2-3380a061b24c tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1271 microversion: 2.1 time: 0.082891 Jun 06 12:15:06.461391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 526/1023] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:06 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:07.478504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:07.479149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:07.487135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:07.487594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:07.488371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:07.488808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:07.624605 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:07.632509 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b0b9d936-b0fa-4d98-bb13-446a21f01c20 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.158029 Jun 06 12:15:07.633098 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 498/1024] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:07 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:08.055527 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:08.056034 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:08.063172 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.063625 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.064401 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.064836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.079665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec HTTP/1.1 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:15:08.083595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.085278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '12b16ad2-de00-48c9-8ebc-92cb9e533fec'} Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:15:08.086120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.087837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.089276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:15:08.089276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-afec2095-a13f-4466-bcc5-f45e6348a95e tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 404 len: 111 microversion: 2.20 time: 0.033348 Jun 06 12:15:08.089276 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 527/1025] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 12:15:08 2022] DELETE /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:15:08.096539 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:08.097239 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 12b16ad2-de00-48c9-8ebc-92cb9e533fec] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:08.103392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.103906 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.104742 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.105288 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.120745 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec HTTP/1.1 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:15:08.123145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.124571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '12b16ad2-de00-48c9-8ebc-92cb9e533fec'} Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:15:08.125332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. Jun 06 12:15:08.126624 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:08.129158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 12b16ad2-de00-48c9-8ebc-92cb9e533fec could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:15:08.130171 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d1439163-4d2c-4b34-a157-6f3db990afe2 tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec" status: 404 len: 111 microversion: 2.20 time: 0.038060 Jun 06 12:15:08.130735 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 499/1026] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:15:08 2022] GET /compute/v2.1/servers/12b16ad2-de00-48c9-8ebc-92cb9e533fec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:15:08.225771 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-185de6df-8932-4999-ad97-45ec799274c0 req-bf25c36a-351c-4e9e-9d0f-b82771fdea58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0a18a7-c71f-4d8e-a9ce-36efeeae5050", "tag": "9b732875-1021-439f-8cbb-8da66f90e944"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:15:08.234403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-185de6df-8932-4999-ad97-45ec799274c0 req-bf25c36a-351c-4e9e-9d0f-b82771fdea58 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.234864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-185de6df-8932-4999-ad97-45ec799274c0 req-bf25c36a-351c-4e9e-9d0f-b82771fdea58 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.248135 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-185de6df-8932-4999-ad97-45ec799274c0 req-bf25c36a-351c-4e9e-9d0f-b82771fdea58 service nova] Creating event network-changed:9b732875-1021-439f-8cbb-8da66f90e944 for instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 on hv-cinder-82549 Jun 06 12:15:08.257666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-185de6df-8932-4999-ad97-45ec799274c0 req-bf25c36a-351c-4e9e-9d0f-b82771fdea58 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032242 Jun 06 12:15:08.258874 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 528/1027] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:15:08.649682 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:08.650301 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:08.656873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.657330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.658106 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:08.658555 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:08.798725 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:08.806474 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-72993e48-ddb7-4f2b-bbde-f92ce5ce222d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.160660 Jun 06 12:15:08.807104 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 500/1028] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:08 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:09.303927 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:09.304516 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:09.310904 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.311360 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.312128 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.312565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.325934 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d HTTP/1.1 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:15:09.327660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.329323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '4a952182-3969-4289-8b82-48c462c44f9d'} Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:15:09.330225 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.331872 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.333337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:15:09.333337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8b76c893-04f8-4449-9ff0-d35e982d4b6a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 404 len: 111 microversion: 2.20 time: 0.029908 Jun 06 12:15:09.333337 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 529/1029] 10.222.0.41 () {60 vars in 1279 bytes} [Mon Jun 6 12:15:09 2022] DELETE /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 12:15:09.337728 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:09.338336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] [instance: 4a952182-3969-4289-8b82-48c462c44f9d] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:09.346213 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.346658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.347453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.347881 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.362518 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] HTTP exception thrown: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Request method failure captured: Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d HTTP/1.1 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine05L3BIflNGHdWp4kZk62XJj9h8IsEDPFKBQR00nDnNqfZ9l1RG7Frl1C7lSRssTTW_48uAYgHJerSD762ZFce-30s8y-gxTOA4rg0ntpCyQ_s94Rzsf7fxINsyf-qkInOryGBMmMNeeAI8mQ9a3KCYJtpkXhW1OeAtI4LoH3mH1bc Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:15:09.364092 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_e4e76a3125df4436abf5f788e35d492f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/e4e76a3125df4436abf5f788e35d492f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: e4e76a3125df4436abf5f788e35d492f Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-319189461 Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: c8bda0c079054e198ffeca4c0ac18bf2 Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-AttachVolumeShelveTestJSON-319189461-project Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.365841 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '4a952182-3969-4289-8b82-48c462c44f9d'} Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:15:09.366757 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. Jun 06 12:15:09.368342 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:15:09.369768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] Returning 404 to user: Instance 4a952182-3969-4289-8b82-48c462c44f9d could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:15:09.369768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-32caa319-16cd-4141-9f6c-8c77205c575a tempest-AttachVolumeShelveTestJSON-319189461 tempest-AttachVolumeShelveTestJSON-319189461-project] 10.222.0.41 "GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d" status: 404 len: 111 microversion: 2.20 time: 0.031685 Jun 06 12:15:09.369768 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 501/1030] 10.222.0.41 () {60 vars in 1276 bytes} [Mon Jun 6 12:15:09 2022] GET /compute/v2.1/servers/4a952182-3969-4289-8b82-48c462c44f9d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 12:15:09.825329 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:09.826074 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:09.832595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.833139 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.833997 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:09.834509 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:09.973983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:09.981455 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b2e44cbd-0bc6-4d0d-8aa6-fa0f2906aacb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.160612 Jun 06 12:15:09.982035 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 530/1031] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:09 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:15:10.998565 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:10.999967 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:11.006754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:11.007236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:11.008020 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:11.008456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:11.173866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:11.194135 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ca0761c0-d570-49fe-9af6-c67111bf40e7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.200365 Jun 06 12:15:11.194729 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 502/1032] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:10 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:12.212120 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:12.212740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:12.235286 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:12.242881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:12.244157 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:12.244796 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:12.474379 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:12.482437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-05eb2cf9-d96d-45c0-bedf-a97a5aeaa3cb tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.274663 Jun 06 12:15:12.492491 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 531/1033] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:12 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:13.500574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:13.501369 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:13.503765 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:13.509831 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:13.510283 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:13.511118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:13.511709 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:13.664951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:13.675089 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7a7e83fb-0918-4888-92d8-7df120ad60cc tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.179088 Jun 06 12:15:13.684539 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 503/1034] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:13 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:14.283052 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:14.285249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:14.520362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-b827cc2b-3bab-43ea-96da-1e48b6e2572d req-2bf3881b-2e80-41e0-805b-8e7061f5cde5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0a18a7-c71f-4d8e-a9ce-36efeeae5050", "name": "network-vif-plugged", "status": "completed", "tag": "9b732875-1021-439f-8cbb-8da66f90e944"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:15:14.529370 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b827cc2b-3bab-43ea-96da-1e48b6e2572d req-2bf3881b-2e80-41e0-805b-8e7061f5cde5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:14.529818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-b827cc2b-3bab-43ea-96da-1e48b6e2572d req-2bf3881b-2e80-41e0-805b-8e7061f5cde5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:14.541248 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-b827cc2b-3bab-43ea-96da-1e48b6e2572d req-2bf3881b-2e80-41e0-805b-8e7061f5cde5 service nova] Creating event network-vif-plugged:9b732875-1021-439f-8cbb-8da66f90e944 for instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 on hv-cinder-82549 Jun 06 12:15:14.547267 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-b827cc2b-3bab-43ea-96da-1e48b6e2572d req-2bf3881b-2e80-41e0-805b-8e7061f5cde5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270446 Jun 06 12:15:14.547878 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 532/1035] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:15:14.694010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:14.694511 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:14.702601 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:14.703076 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:14.703842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:14.704272 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:14.844516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:14.852178 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-4cf6dfbe-3ec9-49d1-87cc-46f03258aa93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.162087 Jun 06 12:15:14.852767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 504/1036] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:14 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:15.873056 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:15.873957 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:15.881022 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:15.881673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:15.882553 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:15.883017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:16.013949 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:16.021494 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-08a861b2-dfe4-4527-a578-71f95a79176f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.154448 Jun 06 12:15:16.022070 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 533/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:15 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:17.039156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:17.039777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:17.047354 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:17.047808 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:17.048580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:17.049020 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:17.185970 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:17.193553 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b35c90e2-df5a-4dcf-8f2d-0d87a2f7d45b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.158337 Jun 06 12:15:17.194129 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 505/1038] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:17 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:18.210732 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:18.211438 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:18.218378 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:18.218826 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:18.219629 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:18.220071 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:18.353161 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:18.361419 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-74f77f1f-03e0-4f5a-9882-0b1c4f380679 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.154559 Jun 06 12:15:18.362220 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 534/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:18 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:19.379005 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:19.379641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:19.386085 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:19.386528 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:19.387323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:19.387754 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:19.517783 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:19.525230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-eba09e5b-d958-4abf-93d5-678fd7d924e0 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.150161 Jun 06 12:15:19.525874 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 506/1040] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:19 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:20.542075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:20.542636 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:20.549390 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:20.549836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:20.550623 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:20.551083 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:20.685402 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:20.692989 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-83db0c9b-f2c6-4997-b528-d4e75111cf07 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.154790 Jun 06 12:15:20.693572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 535/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:20 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:21.711400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:21.712030 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:21.719139 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:21.719595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:21.720628 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:21.721070 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:21.855615 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:21.864027 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f337ddfd-4e40-4b02-9601-29f94cb67a99 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.156621 Jun 06 12:15:21.864613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 507/1042] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:21 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:22.883063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:22.884424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:22.893227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:22.893672 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:22.894505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:22.894983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:23.035851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:23.043405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a28f7272-46dd-4ae7-bbac-b277cb330e9b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.165505 Jun 06 12:15:23.043984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 536/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:22 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:24.060866 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:24.061613 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:24.063981 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:24.069443 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:24.069895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:24.070684 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:24.071156 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:24.073962 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=89 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:24.208208 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:24.216541 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-966915b2-3c6b-4c26-9252-7f084d55c12b tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.159106 Jun 06 12:15:24.217227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 508/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:24 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:25.235808 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:25.236442 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:25.239017 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:25.244443 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:25.244882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:25.245638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:25.246068 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:25.252116 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:25.392887 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:25.400945 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5340d5cc-1d16-42af-8693-52fd85e6e788 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1319 microversion: 2.1 time: 0.170072 Jun 06 12:15:25.401528 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 537/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:25 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:15:26.417407 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:15:26.418015 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:26.424585 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:26.425038 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:26.425797 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:26.426224 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:26.574681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:15:26.584390 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-020e6d86-5349-425a-a217-26c62ff72aac tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1508 microversion: 2.1 time: 0.170900 Jun 06 12:15:26.584978 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 509/1046] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:15:26 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:15:54.751828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86593a53-9240-4c55-931f-af09fe0cd2ef", "device": "/dev/sdb"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:15:54.753602 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:15:54.755877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:54.756595 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=5 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:15:54.763817 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:54.764502 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:54.765229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:15:54.765739 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:15:55.047829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e9ba28ff-0125-4752-b244-ee02bd164801 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "POST /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301190 Jun 06 12:15:55.048870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 538/1047] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:15:54 2022] POST /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:16:48.067008 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=3 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:16:48.068064 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=11 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:16:48.073041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:48.073560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:48.080627 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:48.080993 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:48.081763 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:48.082203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:48.169198 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lazy-loading 'services' on Instance uuid ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:16:48.243700 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f5e0ac9c-3a77-477c-8449-b582ff7be128 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050/os-volume_attachments/86593a53-9240-4c55-931f-af09fe0cd2ef" status: 202 len: 0 microversion: 2.1 time: 0.178241 Jun 06 12:16:48.244687 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 510/1048] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:16:48 2022] DELETE /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050/os-volume_attachments/86593a53-9240-4c55-931f-af09fe0cd2ef => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:16:50.428417 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:16:50.429835 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:16:50.435261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:50.435837 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:50.444170 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:50.444681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:50.446065 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:50.446628 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:50.473611 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:16:50.551354 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-0e7ca690-243d-4c0e-97a2-2d4fcd6b8631 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 204 len: 0 microversion: 2.1 time: 0.124275 Jun 06 12:16:50.552067 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 539/1049] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:16:50 2022] DELETE /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:16:50.561634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:50.562336 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:50.568711 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:50.569168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:50.570578 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:50.571088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:50.728689 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:16:50.736193 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-348baf64-9a7f-4522-8562-f033aa5f1e48 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1514 microversion: 2.1 time: 0.179327 Jun 06 12:16:50.736764 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 511/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:16:50 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:16:51.754182 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:51.754828 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:51.762183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:51.762626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:51.763429 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:51.763864 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:51.917226 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:16:51.925396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-eca735b4-7207-449f-a997-099413c49898 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1514 microversion: 2.1 time: 0.174952 Jun 06 12:16:51.925396 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 540/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:16:51 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:16:52.943315 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:52.944634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:52.952216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:52.952857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:52.953812 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:52.954409 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:53.126031 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:16:53.136180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0ba2a681-4735-4536-be1b-8e78eeb5324f tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 200 len: 1514 microversion: 2.1 time: 0.196989 Jun 06 12:16:53.137884 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 512/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:16:52 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:16:53.436405 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-4f521522-bdda-46c1-b8ff-7b9687586f1b req-3ca82278-27a3-4dd1-bd8e-d772983b75ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0a18a7-c71f-4d8e-a9ce-36efeeae5050", "name": "network-vif-deleted", "tag": "9b732875-1021-439f-8cbb-8da66f90e944"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:16:53.450213 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4f521522-bdda-46c1-b8ff-7b9687586f1b req-3ca82278-27a3-4dd1-bd8e-d772983b75ce service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:53.450664 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4f521522-bdda-46c1-b8ff-7b9687586f1b req-3ca82278-27a3-4dd1-bd8e-d772983b75ce service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:53.464545 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-4f521522-bdda-46c1-b8ff-7b9687586f1b req-3ca82278-27a3-4dd1-bd8e-d772983b75ce service nova] Creating event network-vif-deleted:9b732875-1021-439f-8cbb-8da66f90e944 for instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 on hv-cinder-82549 Jun 06 12:16:53.470355 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-4f521522-bdda-46c1-b8ff-7b9687586f1b req-3ca82278-27a3-4dd1-bd8e-d772983b75ce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037812 Jun 06 12:16:53.471745 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 541/1053] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:16:54.155969 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:16:54.156594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: ec0a18a7-c71f-4d8e-a9ce-36efeeae5050] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:16:54.163964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:54.164415 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:54.166071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:16:54.166523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:16:54.180571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] HTTP exception thrown: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Request method failure captured: Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 HTTP/1.1 Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine_DHnWjcgMPrDGB8kcxvNJF-vmrUaYa26eQSs1u4IbpqcnD4DK2pn6p4VHJlUke_OJ85kJNw0MgUBebRUq8heEkWhfdizWUEUQ67bEK8aq9hXoRrKWfCudPgpR-OTq_QuBNPF50iMbuwUcZqmgNQ2VWa38Fa6hj0pGYJyGe4EAryvo Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 621a97bcf68f4dea8bce2be900c2eefd Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:16:54.182363 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_621a97bcf68f4dea8bce2be900c2eefd", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 621a97bcf68f4dea8bce2be900c2eefd Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-VolumesSnapshotTestJSON-1189045540-project Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 8c4a7545593a45dca9c0029d29910811 Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-VolumesSnapshotTestJSON-1189045540-project Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. Jun 06 12:16:54.184164 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': 'ec0a18a7-c71f-4d8e-a9ce-36efeeae5050'} Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:16:54.185805 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. Jun 06 12:16:54.187464 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:16:54.188869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Returning 404 to user: Instance ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:16:54.188869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c538e7c0-450a-49f9-8622-2275e0ba9537 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050" status: 404 len: 111 microversion: 2.1 time: 0.032456 Jun 06 12:16:54.188869 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 513/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:16:54 2022] GET /compute/v2.1/servers/ec0a18a7-c71f-4d8e-a9ce-36efeeae5050 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 12:17:06.276497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:06.277278 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:06.282740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1141252253", "imageRef": "a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b", "flavorRef": "452", "networks": [{"uuid": "988e0c29-83cf-459a-ab84-02501744471e"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:06.339300 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] validate_networks() for [('988e0c29-83cf-459a-ab84-02501744471e', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:17:06.760320 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:17:06.760709 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:17:06.761222 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:17:06.761676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:17:06.763109 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:17:06.773114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:06.773590 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:06.774468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:06.774939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:06.794731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Getting quotas for project 621a97bcf68f4dea8bce2be900c2eefd. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:17:06.798999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Getting quotas for user 8c4a7545593a45dca9c0029d29910811 and project 621a97bcf68f4dea8bce2be900c2eefd. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:17:06.813098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:17:06.816334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a2cd4ec4-c6c8-4405-a116-d7cd5a68ca5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:17:06.870549 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c128cb44-d5a5-4248-ac22-de20760e1933 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595572 Jun 06 12:17:06.871802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 542/1055] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:17:06.889573 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c0d89360-811f-456f-a093-f47c74ea6b9e tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:06.890328 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c0d89360-811f-456f-a093-f47c74ea6b9e tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:06.895458 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=8 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:06.896244 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:06.972686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c0d89360-811f-456f-a093-f47c74ea6b9e tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:06.986956 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c0d89360-811f-456f-a093-f47c74ea6b9e tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1219 microversion: 2.1 time: 0.106920 Jun 06 12:17:06.988285 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 514/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:06 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:08.008648 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:08.009184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:08.028411 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:08.029114 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:08.030150 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:08.030761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:08.110883 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:08.121112 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-89f3afd0-4ab5-4168-8620-d2a1d9cd4e90 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1279 microversion: 2.1 time: 0.118672 Jun 06 12:17:08.122155 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 543/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:08 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:09.139305 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:09.139874 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:09.148136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:09.148618 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:09.149530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:09.149939 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:09.304704 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:09.314250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-138101b0-f30f-4054-a3c7-a8cd39b3d861 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.179517 Jun 06 12:17:09.314870 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 515/1058] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:09 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:09.815162 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-d43a6e49-959a-4a9f-8a62-79c849e4515c req-9248378f-933c-49d3-a351-c4c7a612fb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12463c20-5e0c-4a2a-8982-ef38d8542538", "tag": "4b1c58bd-2a63-4012-b1a6-96503dd9d1a3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:09.826931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d43a6e49-959a-4a9f-8a62-79c849e4515c req-9248378f-933c-49d3-a351-c4c7a612fb44 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:09.827890 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-d43a6e49-959a-4a9f-8a62-79c849e4515c req-9248378f-933c-49d3-a351-c4c7a612fb44 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:09.841452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-d43a6e49-959a-4a9f-8a62-79c849e4515c req-9248378f-933c-49d3-a351-c4c7a612fb44 service nova] Creating event network-changed:4b1c58bd-2a63-4012-b1a6-96503dd9d1a3 for instance 12463c20-5e0c-4a2a-8982-ef38d8542538 on hv-cinder-82549 Jun 06 12:17:09.847042 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-d43a6e49-959a-4a9f-8a62-79c849e4515c req-9248378f-933c-49d3-a351-c4c7a612fb44 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035770 Jun 06 12:17:09.847991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 544/1059] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:10.332772 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:10.333517 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:10.340370 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:10.340811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:10.341593 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:10.342026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:10.479399 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:10.487598 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b20aca28-e945-4977-89b0-9d2e30aeee93 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.159609 Jun 06 12:17:10.488173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 516/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:10 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:11.506591 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:11.507351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:11.514642 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:11.515122 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:11.515911 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:11.516350 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:11.684048 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:11.703694 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1952082c-6dd1-43eb-a4a4-fee0a963f1bd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.201900 Jun 06 12:17:11.704295 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 545/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:11 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:17:12.723243 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:12.724915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:12.734519 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:12.734519 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:12.737024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:12.737024 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:12.935582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:12.948466 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c78cbf75-1323-45b4-816a-74a533f188d7 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.230834 Jun 06 12:17:12.958676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 517/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:12 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:17:13.966246 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:13.967009 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:13.974310 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:13.975183 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:13.976196 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:13.976684 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:14.237382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:14.251991 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e638b82a-9c4f-41f7-b383-9c410fd31780 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.289983 Jun 06 12:17:14.252583 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 546/1063] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:13 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:15.117333 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:15.117893 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:15.126873 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.127332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.128123 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.128557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.158214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:17:15.306034 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3f3c007c-7309-417d-ae55-bba91a4b8a68 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 204 len: 0 microversion: 2.1 time: 0.192454 Jun 06 12:17:15.307126 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 518/1064] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:17:15 2022] DELETE /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:17:15.316131 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:15.317349 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:15.335132 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.335756 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.336688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.337264 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.433395 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-e5f0c490-13e7-4ce1-bda1-1fc061c78367 req-524f5adc-4381-416a-ac52-657a8186fd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d371d348-2300-4843-978b-76a2d50d2a87", "tag": "cd03940a-edbd-4ee6-93ac-c00876093d85"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:15.448168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e5f0c490-13e7-4ce1-bda1-1fc061c78367 req-524f5adc-4381-416a-ac52-657a8186fd18 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.448822 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-e5f0c490-13e7-4ce1-bda1-1fc061c78367 req-524f5adc-4381-416a-ac52-657a8186fd18 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.463413 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-e5f0c490-13e7-4ce1-bda1-1fc061c78367 req-524f5adc-4381-416a-ac52-657a8186fd18 service nova] Creating event network-changed:cd03940a-edbd-4ee6-93ac-c00876093d85 for instance d371d348-2300-4843-978b-76a2d50d2a87 on hv-cinder-82549 Jun 06 12:17:15.471714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-e5f0c490-13e7-4ce1-bda1-1fc061c78367 req-524f5adc-4381-416a-ac52-657a8186fd18 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.354285 Jun 06 12:17:15.472889 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 547/1065] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:17:15.482802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:15.483700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:15.491040 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.491040 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.492100 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:15.493714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:15.535212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:15.543409 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a6cb2b4b-4d6e-4088-a3a1-374318aedec5 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.234338 Jun 06 12:17:15.545767 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 519/1066] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:15 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:15.707866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:15.716445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-340f8267-829f-447e-9dc9-7165ea36a8eb tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1578 microversion: 2.1 time: 0.241941 Jun 06 12:17:15.717762 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 548/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:15 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1578 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:16.564449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:16.565188 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:16.572777 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:16.573266 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:16.574179 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:16.574625 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:16.711062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:16.719168 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-29c55077-031a-4979-8eee-4f1b60433b97 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.159390 Jun 06 12:17:16.721071 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 520/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:16 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:17:16.735961 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:16.736857 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:16.749505 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:16.749959 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:16.750738 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:16.751202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:16.784923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:16.806755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:16.878173 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-7b7d6833-e3b3-4780-be45-6a368d8032f3 req-392efd71-9a38-4e74-9663-fb07df63fe06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12463c20-5e0c-4a2a-8982-ef38d8542538", "name": "network-vif-plugged", "status": "completed", "tag": "4b1c58bd-2a63-4012-b1a6-96503dd9d1a3"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:16.889430 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7b7d6833-e3b3-4780-be45-6a368d8032f3 req-392efd71-9a38-4e74-9663-fb07df63fe06 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:16.890488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-7b7d6833-e3b3-4780-be45-6a368d8032f3 req-392efd71-9a38-4e74-9663-fb07df63fe06 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:16.904441 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-7b7d6833-e3b3-4780-be45-6a368d8032f3 req-392efd71-9a38-4e74-9663-fb07df63fe06 service nova] Creating event network-vif-plugged:4b1c58bd-2a63-4012-b1a6-96503dd9d1a3 for instance 12463c20-5e0c-4a2a-8982-ef38d8542538 on hv-cinder-82549 Jun 06 12:17:16.909532 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-7b7d6833-e3b3-4780-be45-6a368d8032f3 req-392efd71-9a38-4e74-9663-fb07df63fe06 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Jun 06 12:17:16.910353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 521/1069] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:16.950375 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:16.958572 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-37183b97-1912-47cd-bfbd-a45e5efa4cd4 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1578 microversion: 2.1 time: 0.228149 Jun 06 12:17:16.959180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 549/1070] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:16 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:17.734434 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:17.739693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:17.740407 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:17.747116 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:17.748299 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:17.748912 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:17.749345 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:17.827868 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-951b1773-53ce-4e0e-a1ac-6127144b305d req-d633ee1a-d007-4473-8689-38c20aae6d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d371d348-2300-4843-978b-76a2d50d2a87", "name": "network-vif-deleted", "tag": "cd03940a-edbd-4ee6-93ac-c00876093d85"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:17.837280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-951b1773-53ce-4e0e-a1ac-6127144b305d req-d633ee1a-d007-4473-8689-38c20aae6d49 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:17.837836 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-951b1773-53ce-4e0e-a1ac-6127144b305d req-d633ee1a-d007-4473-8689-38c20aae6d49 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:17.850422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-951b1773-53ce-4e0e-a1ac-6127144b305d req-d633ee1a-d007-4473-8689-38c20aae6d49 service nova] Creating event network-vif-deleted:cd03940a-edbd-4ee6-93ac-c00876093d85 for instance d371d348-2300-4843-978b-76a2d50d2a87 on hv-cinder-82549 Jun 06 12:17:17.855332 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-951b1773-53ce-4e0e-a1ac-6127144b305d req-d633ee1a-d007-4473-8689-38c20aae6d49 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031638 Jun 06 12:17:17.855931 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 550/1071] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:17:17.899190 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:17.907447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-7c97d540-1c00-4102-b178-d1d51378acf3 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.173932 Jun 06 12:17:17.908025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 522/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:17 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:17.976799 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:17.977499 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:17.985194 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:17.985740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:17.986559 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:17.987283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:18.069316 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:18.077941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-229d9de7-f26b-4c63-ad2a-b97c75fc52fa tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1226 microversion: 2.1 time: 0.105633 Jun 06 12:17:18.078477 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 551/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:17 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:18.925531 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:18.926070 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:18.932594 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:18.933049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:18.933813 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:18.934253 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:19.074480 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:19.082635 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-d958d4a5-21f3-4bc3-9518-f2e5b4948280 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1319 microversion: 2.1 time: 0.160955 Jun 06 12:17:19.083290 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 523/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:18 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:19.099087 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:19.100400 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:19.111302 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:19.112039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:19.113285 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:19.114021 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:19.151012 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:19.151356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:19.151804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lazy-loading 'fault' on Instance uuid d371d348-2300-4843-978b-76a2d50d2a87 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:17:19.203305 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:19.212484 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-67330f18-ad9c-4d7d-8042-9c1c5ca49db0 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 200 len: 1231 microversion: 2.1 time: 0.119873 Jun 06 12:17:19.213168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 552/1075] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:19 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:20.101273 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:20.101885 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:20.109425 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.109875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.110658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.111139 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.233899 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:20.234551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: d371d348-2300-4843-978b-76a2d50d2a87] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:20.243063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.243876 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.245332 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.246133 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.267013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] HTTP exception thrown: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Request method failure captured: Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 HTTP/1.1 Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine3sJI2mhZtIasT71Qe58wfN9Wl2hfV7qna7W9pJjnw9LmhWRbFIpLtP1pmpsb5E2Tzyi6U5p_enMUJRZhPR0KC6SdfEOiyJqabxkmrokasox4nfEGZrUgcKyM4fuk0HzSJSXuTANWX4_gXZ-ToCY9B_56IFj5PYWVlJUzL1Z6U2bWE Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:17:20.268552 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c80560ca253e41239020e2c008a9b3ba", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: adb92379209e46e79de4df370183fa8a Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. Jun 06 12:17:20.270227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'd371d348-2300-4843-978b-76a2d50d2a87'} Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:17:20.271202 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. Jun 06 12:17:20.272829 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:20.275652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Returning 404 to user: Instance d371d348-2300-4843-978b-76a2d50d2a87 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:17:20.275652 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-90ce0940-c9e8-4844-ae18-93e7fca34733 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87" status: 404 len: 111 microversion: 2.1 time: 0.040992 Jun 06 12:17:20.276654 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:20.276867 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 553/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:20 2022] GET /compute/v2.1/servers/d371d348-2300-4843-978b-76a2d50d2a87 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:17:20.280149 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6bbd5bc4-7dc0-4093-8e6b-85e6b6a57aef tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1507 microversion: 2.1 time: 0.182805 Jun 06 12:17:20.287658 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 524/1077] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:20 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:20.299813 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc17b8b5-32b4-4740-b216-78555ffbcd35", "device": "/dev/sdb"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:20.301896 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:20.311861 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.312606 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.313883 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:20.314610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:20.597772 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7ff30716-2936-4e93-979b-28bd0517032a tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "POST /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301626 Jun 06 12:17:20.598526 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 554/1078] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:17:20 2022] POST /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:23.016595 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:17:23.017371 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:17:23.545997 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-5ef6d47d-0489-40b2-9fdf-40c64574cb68 req-b55a9df9-3af2-49f5-97c0-e231942aa029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e705bc7b-fa65-4964-8568-aed2910f5d3f", "tag": "a37d411c-8de5-4f08-92d3-aa87b62b7883"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:23.547259 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:23.547855 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:23.556107 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5ef6d47d-0489-40b2-9fdf-40c64574cb68 req-b55a9df9-3af2-49f5-97c0-e231942aa029 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:23.556356 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:23.556620 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:23.556897 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-5ef6d47d-0489-40b2-9fdf-40c64574cb68 req-b55a9df9-3af2-49f5-97c0-e231942aa029 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:23.557566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:23.558036 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:23.572640 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-5ef6d47d-0489-40b2-9fdf-40c64574cb68 req-b55a9df9-3af2-49f5-97c0-e231942aa029 service nova] Creating event network-changed:a37d411c-8de5-4f08-92d3-aa87b62b7883 for instance e705bc7b-fa65-4964-8568-aed2910f5d3f on hv-cinder-82549 Jun 06 12:17:23.579504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-5ef6d47d-0489-40b2-9fdf-40c64574cb68 req-b55a9df9-3af2-49f5-97c0-e231942aa029 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037785 Jun 06 12:17:23.580422 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 525/1079] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:23.595391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:17:23.722293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-7884d4f6-c89a-4619-b267-fec5305c3517 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 204 len: 0 microversion: 2.1 time: 0.179619 Jun 06 12:17:23.724194 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 555/1080] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:17:23 2022] DELETE /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:17:23.734230 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:23.734993 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:23.743971 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:23.744439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:23.746451 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:23.746951 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:23.926442 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:23.936158 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-3e8a7dae-1e50-49b5-878f-a7e33653d99e tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1576 microversion: 2.1 time: 0.206483 Jun 06 12:17:23.937492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 526/1081] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:23 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:24.955601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:24.956448 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:24.963154 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:24.963942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:24.964866 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:24.965404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:25.124687 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adb92379209e46e79de4df370183fa8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c80560ca253e41239020e2c008a9b3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:25.132807 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ff3dac3f-116d-4796-b00f-9f4429d1fac3 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 200 len: 1458 microversion: 2.1 time: 0.182624 Jun 06 12:17:25.133551 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 556/1082] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:24 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 1458 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:25.260697 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-1628b6b7-edab-46d4-8131-7675b49e2960 req-eaf6174d-01fd-4091-ac92-b002112acfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e705bc7b-fa65-4964-8568-aed2910f5d3f", "name": "network-vif-deleted", "tag": "a37d411c-8de5-4f08-92d3-aa87b62b7883"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:25.271649 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1628b6b7-edab-46d4-8131-7675b49e2960 req-eaf6174d-01fd-4091-ac92-b002112acfc4 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:25.273696 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-1628b6b7-edab-46d4-8131-7675b49e2960 req-eaf6174d-01fd-4091-ac92-b002112acfc4 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:25.285816 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-1628b6b7-edab-46d4-8131-7675b49e2960 req-eaf6174d-01fd-4091-ac92-b002112acfc4 service nova] Creating event network-vif-deleted:a37d411c-8de5-4f08-92d3-aa87b62b7883 for instance e705bc7b-fa65-4964-8568-aed2910f5d3f on hv-cinder-82549 Jun 06 12:17:25.291247 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-1628b6b7-edab-46d4-8131-7675b49e2960 req-eaf6174d-01fd-4091-ac92-b002112acfc4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Jun 06 12:17:25.292049 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 527/1083] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:26.152895 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:26.154731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: e705bc7b-fa65-4964-8568-aed2910f5d3f] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:26.162536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.163179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.164437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.165016 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.182334 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] HTTP exception thrown: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Request method failure captured: Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f HTTP/1.1 Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine3sJI2mhZtIasT71Qe58wfN9Wl2hfV7qna7W9pJjnw9LmhWRbFIpLtP1pmpsb5E2Tzyi6U5p_enMUJRZhPR0KC6SdfEOiyJqabxkmrokasox4nfEGZrUgcKyM4fuk0HzSJSXuTANWX4_gXZ-ToCY9B_56IFj5PYWVlJUzL1Z6U2bWE Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:17:26.183942 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c80560ca253e41239020e2c008a9b3ba", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: adb92379209e46e79de4df370183fa8a Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. Jun 06 12:17:26.186936 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': 'e705bc7b-fa65-4964-8568-aed2910f5d3f'} Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:17:26.188165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. Jun 06 12:17:26.190660 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.194975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Returning 404 to user: Instance e705bc7b-fa65-4964-8568-aed2910f5d3f could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:17:26.194975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5e5336c1-b8bc-4ce4-8492-1ee2c1908174 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f" status: 404 len: 111 microversion: 2.1 time: 0.037058 Jun 06 12:17:26.194975 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 557/1084] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:26 2022] GET /compute/v2.1/servers/e705bc7b-fa65-4964-8568-aed2910f5d3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:17:26.773616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:26.773616 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:26.780959 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.781400 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.782291 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.782602 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.797240 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] HTTP exception thrown: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Request method failure captured: Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea HTTP/1.1 Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABine3sJI2mhZtIasT71Qe58wfN9Wl2hfV7qna7W9pJjnw9LmhWRbFIpLtP1pmpsb5E2Tzyi6U5p_enMUJRZhPR0KC6SdfEOiyJqabxkmrokasox4nfEGZrUgcKyM4fuk0HzSJSXuTANWX4_gXZ-ToCY9B_56IFj5PYWVlJUzL1Z6U2bWE Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:17:26.798982 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c80560ca253e41239020e2c008a9b3ba", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: adb92379209e46e79de4df370183fa8a Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.800698 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '105b21a4-46f9-4578-a9d6-7e368603efea'} Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:17:26.801743 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.803386 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.805125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Returning 404 to user: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:17:26.805125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-55fbb0ee-40c9-45f3-9589-7f8aa1d2e3da tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "DELETE /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 404 len: 111 microversion: 2.1 time: 0.033567 Jun 06 12:17:26.805125 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 528/1085] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:17:26 2022] DELETE /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:17:26.810057 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:26.810903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] [instance: 105b21a4-46f9-4578-a9d6-7e368603efea] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:26.819244 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.819686 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.820452 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:26.820877 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:26.838640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] HTTP exception thrown: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Request method failure captured: Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea HTTP/1.1 Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine3sJI2mhZtIasT71Qe58wfN9Wl2hfV7qna7W9pJjnw9LmhWRbFIpLtP1pmpsb5E2Tzyi6U5p_enMUJRZhPR0KC6SdfEOiyJqabxkmrokasox4nfEGZrUgcKyM4fuk0HzSJSXuTANWX4_gXZ-ToCY9B_56IFj5PYWVlJUzL1Z6U2bWE Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:17:26.840234 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c80560ca253e41239020e2c008a9b3ba", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c80560ca253e41239020e2c008a9b3ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: c80560ca253e41239020e2c008a9b3ba Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-TestVolumeBootPattern-1228795796 Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: adb92379209e46e79de4df370183fa8a Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-TestVolumeBootPattern-1228795796-project Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.843854 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '105b21a4-46f9-4578-a9d6-7e368603efea'} Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:17:26.844996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. Jun 06 12:17:26.847145 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:26.849406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Returning 404 to user: Instance 105b21a4-46f9-4578-a9d6-7e368603efea could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:17:26.849406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-03d193ba-5616-4f57-9171-0a92806cf0f1 tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea" status: 404 len: 111 microversion: 2.1 time: 0.036861 Jun 06 12:17:26.849406 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 558/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:26 2022] GET /compute/v2.1/servers/105b21a4-46f9-4578-a9d6-7e368603efea => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:17:28.210820 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cf73f10a-7847-4ed3-a6e7-57bb558dc07a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] Calling method '.version_select at 0x7fc16834caf0>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:28.253028 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cf73f10a-7847-4ed3-a6e7-57bb558dc07a tempest-TestVolumeBootPattern-1228795796 tempest-TestVolumeBootPattern-1228795796-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2130326679" status: 202 len: 0 microversion: 2.1 time: 0.046029 Jun 06 12:17:28.253857 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 529/1087] 10.222.0.41 () {58 vars in 1262 bytes} [Mon Jun 6 12:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2130326679 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 12:17:39.813589 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:17:39.814436 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:17:42.309586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:42.310230 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:42.312806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:42.313999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:42.321283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:42.321731 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:42.322519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:42.322999 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:42.429178 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.objects.instance [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lazy-loading 'services' on Instance uuid 12463c20-5e0c-4a2a-8982-ef38d8542538 {{(pid=117629) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:17:42.503908 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-a52d231a-1df3-4671-8c5f-5e2f74a61b23 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538/os-volume_attachments/dc17b8b5-32b4-4740-b216-78555ffbcd35" status: 202 len: 0 microversion: 2.1 time: 0.198086 Jun 06 12:17:42.504666 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 559/1088] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:17:42 2022] DELETE /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538/os-volume_attachments/dc17b8b5-32b4-4740-b216-78555ffbcd35 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:17:43.625120 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:43.625669 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:43.628523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:43.629506 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:17:43.637052 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:43.637641 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:43.638516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:43.638977 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:43.666731 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Going to try to terminate instance {{(pid=117630) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:17:43.744574 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-9ba831dc-80e0-49ee-a076-50c719c41660 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "DELETE /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 204 len: 0 microversion: 2.1 time: 0.122980 Jun 06 12:17:43.745211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 530/1089] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:17:43 2022] DELETE /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:17:43.755131 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:43.756060 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:43.762803 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:43.763283 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:43.764059 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:43.764497 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:44.136005 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:44.143841 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-8d19cd07-6c22-4ccf-ac46-c23dfdee26aa tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1513 microversion: 2.1 time: 0.394018 Jun 06 12:17:44.144359 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 560/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:43 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:17:45.161720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:45.162457 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:45.169041 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:45.169492 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:45.170260 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:45.170695 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:45.302811 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:45.310447 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-70874229-e267-4bd0-9c4d-f7c5d9a13d84 tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1513 microversion: 2.1 time: 0.153481 Jun 06 12:17:45.311056 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 531/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:45 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:46.329456 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:46.330207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-656a6ed8-1fe6-4443-902f-ccb5c0fd43c3 req-e029f63d-7945-4f4c-aa06-3dacb8a13f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12463c20-5e0c-4a2a-8982-ef38d8542538", "name": "network-vif-deleted", "tag": "4b1c58bd-2a63-4012-b1a6-96503dd9d1a3"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:17:46.331203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:46.338238 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:46.338607 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:46.339414 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:46.339802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-656a6ed8-1fe6-4443-902f-ccb5c0fd43c3 req-e029f63d-7945-4f4c-aa06-3dacb8a13f19 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:46.339915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:46.340238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-656a6ed8-1fe6-4443-902f-ccb5c0fd43c3 req-e029f63d-7945-4f4c-aa06-3dacb8a13f19 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:46.359105 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-656a6ed8-1fe6-4443-902f-ccb5c0fd43c3 req-e029f63d-7945-4f4c-aa06-3dacb8a13f19 service nova] Creating event network-vif-deleted:4b1c58bd-2a63-4012-b1a6-96503dd9d1a3 for instance 12463c20-5e0c-4a2a-8982-ef38d8542538 on hv-cinder-82549 Jun 06 12:17:46.364209 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-656a6ed8-1fe6-4443-902f-ccb5c0fd43c3 req-e029f63d-7945-4f4c-aa06-3dacb8a13f19 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038416 Jun 06 12:17:46.364802 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 561/1092] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:17:46.418088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c4a7545593a45dca9c0029d29910811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '621a97bcf68f4dea8bce2be900c2eefd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:17:46.426257 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-61e6eb3b-c581-431c-9f92-85225d454fdd tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 200 len: 1471 microversion: 2.1 time: 0.100587 Jun 06 12:17:46.427117 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 532/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:46 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 1471 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:17:47.445468 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:17:47.446163 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] [instance: 12463c20-5e0c-4a2a-8982-ef38d8542538] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:17:47.452364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:47.452804 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:47.453555 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:17:47.453986 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:17:47.467667 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.wsgi [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] HTTP exception thrown: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Request method failure captured: Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: request: GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 HTTP/1.1 Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept: application/json Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Accept-Encoding: identity Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Connection: close Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Length: 0 Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Content-Type: application/json Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Host: 10.222.0.41 Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Openstack-System-Scope: None Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: User-Agent: python-urllib3/1.26.9 Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Auth-Token: gAAAAABine_DHnWjcgMPrDGB8kcxvNJF-vmrUaYa26eQSs1u4IbpqcnD4DK2pn6p4VHJlUke_OJ85kJNw0MgUBebRUq8heEkWhfdizWUEUQ67bEK8aq9hXoRrKWfCudPgpR-OTq_QuBNPF50iMbuwUcZqmgNQ2VWa38Fa6hj0pGYJyGe4EAryvo Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Id: None Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Domain-Name: None Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Identity-Status: Confirmed Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Is-Admin-Project: True Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Id: default Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Domain-Name: Default Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Id: 621a97bcf68f4dea8bce2be900c2eefd Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Role: member,reader Jun 06 12:17:47.469347 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Roles: member,reader Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_621a97bcf68f4dea8bce2be900c2eefd", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/621a97bcf68f4dea8bce2be900c2eefd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Id: 621a97bcf68f4dea8bce2be900c2eefd Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1189045540 Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User: tempest-VolumesSnapshotTestJSON-1189045540-project Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Id: default Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Domain-Name: Default Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Id: 8c4a7545593a45dca9c0029d29910811 Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: X-User-Name: tempest-VolumesSnapshotTestJSON-1189045540-project Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: method: > Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: exception: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. Jun 06 12:17:47.470923 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: action_args: {'id': '12463c20-5e0c-4a2a-8982-ef38d8542538'} Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:17:47.473427 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. Jun 06 12:17:47.475018 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: ERROR nova.api.openstack.wsgi Jun 06 12:17:47.476542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] Returning 404 to user: Instance 12463c20-5e0c-4a2a-8982-ef38d8542538 could not be found. {{(pid=117629) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:17:47.476542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6f6c9848-d629-4bf5-910d-9437dc16c28d tempest-VolumesSnapshotTestJSON-1189045540 tempest-VolumesSnapshotTestJSON-1189045540-project] 10.222.0.41 "GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538" status: 404 len: 111 microversion: 2.1 time: 0.030350 Jun 06 12:17:47.476542 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 562/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:17:47 2022] GET /compute/v2.1/servers/12463c20-5e0c-4a2a-8982-ef38d8542538 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:18:33.950146 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-63cf23b2-2c17-46c4-afa9-04ef8b08d9ca tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'create', calling method: .version_select at 0x7fc1682af040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1743696444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJh41BvaasNPlOPsICoPXE9bVzZKbHpQWJEuCO9f9MNBzUWIoK37DIp8iicc1XXTlX4LVCmzKDHW6xrJcw+dYdEbsZccp32t7QzKW5UUOXr1aqT8pZ8miKTHuRfKkcDbkg=="}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:18:33.955025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:33.955688 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:33.983514 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-63cf23b2-2c17-46c4-afa9-04ef8b08d9ca tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Getting quotas for project 101a824926d14b078830ace554e9ff3d. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:18:33.988238 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.quota [None req-63cf23b2-2c17-46c4-afa9-04ef8b08d9ca tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Getting quotas for user 7c132e34c7e341f9bd753efd38f4fbbd and project 101a824926d14b078830ace554e9ff3d. Resources: {'key_pairs'} {{(pid=117630) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:18:34.016265 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-63cf23b2-2c17-46c4-afa9-04ef8b08d9ca tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.070035 Jun 06 12:18:34.016871 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 533/1095] 10.222.0.41 () {60 vars in 1158 bytes} [Mon Jun 6 12:18:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:18:34.067397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-286794303", "imageRef": "f17bcac1-60f2-4de9-a0f6-e8bab2867583", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1743696444", "networks": [{"uuid": "f7b15def-481b-47f0-9c44-075b61d85c09"}]}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:18:34.074280 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=8 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:34.074985 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:34.120746 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.network.neutron [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] validate_networks() for [('f7b15def-481b-47f0-9c44-075b61d85c09', None, None, None, None, None)] {{(pid=117629) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 12:18:34.503493 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Flavor limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 12:18:34.503941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Image limits 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 12:18:34.504440 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Flavor pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 12:18:34.505404 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Image pref 0:0:0 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 12:18:34.505812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.virt.hardware [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117629) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 12:18:34.514673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:34.515141 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:34.515935 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:34.516364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:34.533428 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Getting quotas for project 101a824926d14b078830ace554e9ff3d. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 12:18:34.537382 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.quota [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Getting quotas for user 7c132e34c7e341f9bd753efd38f4fbbd and project 101a824926d14b078830ace554e9ff3d. Resources: {'instances', 'cores', 'ram'} {{(pid=117629) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 12:18:34.548013 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Going to run 1 instances... {{(pid=117629) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 12:18:34.550187 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f17bcac1-60f2-4de9-a0f6-e8bab2867583',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117629) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 12:18:34.595566 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f31c36fb-9601-4de5-9ce1-fdd7e71a19b1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532064 Jun 06 12:18:34.596205 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 563/1096] 10.222.0.41 () {60 vars in 1146 bytes} [Mon Jun 6 12:18:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 12:18:34.606227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c4d3e703-abb6-47f1-bf09-66237e73bd33 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:34.607014 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c4d3e703-abb6-47f1-bf09-66237e73bd33 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:34.667327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c4d3e703-abb6-47f1-bf09-66237e73bd33 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:34.674702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c4d3e703-abb6-47f1-bf09-66237e73bd33 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1258 microversion: 2.1 time: 0.072614 Jun 06 12:18:34.675392 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 534/1097] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:34 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:18:35.692806 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:35.693716 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:35.700781 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:35.701439 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:35.702261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:35.702704 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:35.772362 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:35.780373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-873b251e-2836-4547-a6ac-fb503da235ee tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1328 microversion: 2.1 time: 0.092263 Jun 06 12:18:35.780958 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 564/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:35 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:36.802059 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:36.803002 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:36.811323 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:36.812313 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:36.813570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:36.814294 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:36.994571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:37.010215 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-cd643732-41b7-4165-96b9-111032e0664e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.212637 Jun 06 12:18:37.010449 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 535/1099] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:36 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:38.028189 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:38.028784 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:38.035360 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:38.035798 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:38.037720 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:38.038180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:38.198519 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:38.210229 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-16ae0584-de95-4783-8432-c5dad4cd25ae tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.186055 Jun 06 12:18:38.211186 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 565/1100] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:38 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:39.228875 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:39.230260 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:39.237113 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:39.237552 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:39.238314 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:39.238741 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:39.377547 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:39.386250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b25cfb4e-5e4f-41d1-ae2e-abfc399d3eda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.161446 Jun 06 12:18:39.386819 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 536/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:39 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:40.405097 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:40.405723 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:40.424487 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:40.424929 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:40.425719 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:40.426153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:40.587882 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:40.595984 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c3ccf72c-0908-494e-8e83-820a161c64d7 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.194650 Jun 06 12:18:40.596845 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 566/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:40 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:41.620927 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:41.621593 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:41.629755 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:41.630332 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:41.632306 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:41.633171 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:41.813812 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:41.825702 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-0abd3345-bc35-4b4f-a457-bf2fe52ee910 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.212680 Jun 06 12:18:41.826715 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 537/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:41 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:18:42.844471 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:42.845085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:42.852311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:42.852761 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:42.853790 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:42.854242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:43.018776 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:43.032423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-400a0972-3a92-4f7f-8d29-8ab1aeae3c9a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.191439 Jun 06 12:18:43.034384 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 567/1104] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:42 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:44.049707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:44.050543 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:44.059062 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:44.059516 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:44.060313 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:44.060758 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:44.245460 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:44.253327 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-fef32bb9-334e-4d91-99c6-f52b1811dabd tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.207461 Jun 06 12:18:44.253908 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 538/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:44 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:45.270500 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:45.271351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:45.273810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=2 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:45.274821 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell0:SELECT=6 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:45.281714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:45.282165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:45.282983 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:45.283423 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:45.588812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:45.598085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d4ae1381-7d05-4e85-9e1e-aed21cdfdad2 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.331398 Jun 06 12:18:45.598676 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 568/1106] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:45 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:46.617009 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:46.617634 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:46.619498 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=6 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:18:46.625781 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:46.626223 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:46.627021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:46.627453 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:46.770795 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:46.779010 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-72e4d3ad-7f43-4ec8-bbd1-a9c14b880418 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.166383 Jun 06 12:18:46.779596 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 539/1107] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:46 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:18:47.796844 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:47.797574 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:47.804190 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:47.804638 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:47.805420 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:47.805856 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:47.950536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:47.961200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d0c8d7a4-3f84-4f76-8dc8-bd1acf5223c1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.168055 Jun 06 12:18:47.962184 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 569/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:47 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:48.356235 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-b3eedcd1-35f0-4bc0-bde7-be7a2bcce812 req-a1f586ac-b08b-44d6-906a-abda38ef57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:18:48.365986 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b3eedcd1-35f0-4bc0-bde7-be7a2bcce812 req-a1f586ac-b08b-44d6-906a-abda38ef57a5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:48.366693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-b3eedcd1-35f0-4bc0-bde7-be7a2bcce812 req-a1f586ac-b08b-44d6-906a-abda38ef57a5 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:48.379216 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-b3eedcd1-35f0-4bc0-bde7-be7a2bcce812 req-a1f586ac-b08b-44d6-906a-abda38ef57a5 service nova] Creating event network-changed:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:18:48.391845 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-b3eedcd1-35f0-4bc0-bde7-be7a2bcce812 req-a1f586ac-b08b-44d6-906a-abda38ef57a5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040639 Jun 06 12:18:48.393040 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 540/1109] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:18:48.980818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:48.981565 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:48.988104 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:48.988571 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:48.989339 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:48.989845 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:49.130165 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:49.138129 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1892b137-587d-4acc-a63d-e7d6155b9daf tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.161371 Jun 06 12:18:49.138711 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 570/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:48 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:50.157067 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:50.157782 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:50.165338 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:50.165790 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:50.166588 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:50.167065 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:50.308979 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:50.316551 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-f1b16bdb-10ae-43c6-b08a-6c41daba9b39 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.164198 Jun 06 12:18:50.317029 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 541/1111] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:50 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:51.333862 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:51.335232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:51.344812 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:51.345311 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:51.346174 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:51.346610 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:51.515560 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:51.526180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-574c3cbd-450f-4020-848d-b37dd4e5e48e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.195533 Jun 06 12:18:51.526180 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 571/1112] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:51 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:52.543124 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:52.543752 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:52.550591 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:52.551091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:52.552910 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:52.553454 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:52.697545 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:52.705068 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-19107de1-651e-4d83-aa10-b96b3c4e6867 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.166379 Jun 06 12:18:52.705647 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 542/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:52 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:18:53.036015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-7ca795a8-c5ce-46cf-aeb2-90f796d92f60 req-ec459df0-c5da-4e7f-a2a3-b676b704cdd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "name": "network-vif-plugged", "status": "completed", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:18:53.050063 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7ca795a8-c5ce-46cf-aeb2-90f796d92f60 req-ec459df0-c5da-4e7f-a2a3-b676b704cdd3 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:53.050722 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-7ca795a8-c5ce-46cf-aeb2-90f796d92f60 req-ec459df0-c5da-4e7f-a2a3-b676b704cdd3 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:53.064898 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-7ca795a8-c5ce-46cf-aeb2-90f796d92f60 req-ec459df0-c5da-4e7f-a2a3-b676b704cdd3 service nova] Creating event network-vif-plugged:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:18:53.072902 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-7ca795a8-c5ce-46cf-aeb2-90f796d92f60 req-ec459df0-c5da-4e7f-a2a3-b676b704cdd3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040774 Jun 06 12:18:53.073981 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 572/1114] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:18:53.722495 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:53.723137 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:53.729915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:53.730358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:53.731461 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:53.731902 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:53.866222 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:53.873761 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-ae2ae892-5bd7-4ffa-b2ca-0942847e2e27 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.155163 Jun 06 12:18:53.874341 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 543/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:53 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:54.892173 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:54.892907 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:54.901852 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:54.902403 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:54.903428 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:54.903977 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:55.056075 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:55.063765 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6f282eb5-ecc5-45ac-8475-4c2ecc84a44a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1358 microversion: 2.1 time: 0.175978 Jun 06 12:18:55.064333 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 573/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:54 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:56.086221 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:56.086859 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:56.093566 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.094016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.094780 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.095236 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.237155 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:56.244850 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c9142e84-da69-4a43-ae3f-2c5f10a03b43 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1549 microversion: 2.1 time: 0.163816 Jun 06 12:18:56.245439 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 544/1117] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:56 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:18:56.262693 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:56.263517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:56.270323 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.270698 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.272386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.272870 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.407809 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:56.416168 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-ee1d5538-3c2a-483b-b994-e52efb76ecc1 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1549 microversion: 2.1 time: 0.157404 Jun 06 12:18:56.416744 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 574/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:56 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:56.432358 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:56.435724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:56.436488 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Searching by: {'deleted': False, 'project_id': '101a824926d14b078830ace554e9ff3d'} {{(pid=117630) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 12:18:56.443918 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.444467 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.445263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.445694 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.540524 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.multi_cell_list [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117630) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 12:18:56.641633 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-48ffcbeb-0179-4c7a-8519-f8c7385c77f3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212952 Jun 06 12:18:56.642227 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 545/1119] 10.222.0.41 () {58 vars in 1124 bytes} [Mon Jun 6 12:18:56 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:18:56.653980 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:18:56.654586 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:56.660643 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.661086 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.661990 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:56.662424 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:56.825626 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:18:56.833317 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-5d4708de-857b-4dce-95dc-bb41cf8d4d23 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1549 microversion: 2.1 time: 0.183770 Jun 06 12:18:56.833778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 575/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:18:56 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:18:58.378483 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bb01600-f777-474d-967f-d7495d9596a7"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:18:58.379582 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:18:58.386229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:58.386668 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:58.387473 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:18:58.387907 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:18:58.665263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a4e24b82-9542-41f0-9497-54cfa6846a48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290594 Jun 06 12:18:58.665915 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 546/1121] 10.222.0.41 () {60 vars in 1322 bytes} [Mon Jun 6 12:18:58 2022] POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:19:02.477521 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:19:02.478203 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:19:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:19:06.266563 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:19:06.267386 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:19:06.269926 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:19:06.277039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:06.277488 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:06.278270 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:06.278700 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:06.281965 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=71 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:19:06.420508 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:19:06.429422 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c74e1c99-12dd-4418-8a75-0663c5617dfe tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1595 microversion: 2.1 time: 0.166628 Jun 06 12:19:06.430011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 576/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:19:06 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:19:08.593664 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell0:SELECT=2 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:19:08.595088 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:19:08.601414 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-fecda8a7-4205-4523-a874-6eb4bc87afbd req-929add66-dcfa-41ce-b473-b302e5c09d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:19:08.611964 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fecda8a7-4205-4523-a874-6eb4bc87afbd req-929add66-dcfa-41ce-b473-b302e5c09d1e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:08.612570 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-fecda8a7-4205-4523-a874-6eb4bc87afbd req-929add66-dcfa-41ce-b473-b302e5c09d1e service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:08.619079 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:19:08.627925 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-fecda8a7-4205-4523-a874-6eb4bc87afbd req-929add66-dcfa-41ce-b473-b302e5c09d1e service nova] Creating event network-changed:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:19:08.634237 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-fecda8a7-4205-4523-a874-6eb4bc87afbd req-929add66-dcfa-41ce-b473-b302e5c09d1e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041894 Jun 06 12:19:08.635279 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 547/1123] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:19:09.971811 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1489905196"}} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:19:09.972388 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:19:09.980123 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:09.980573 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:09.981351 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:09.981788 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:10.113293 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.network.security_group_api [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Adding security group 9afdcf0c-fcd9-469e-978b-ae56d9f500a2 to port 551ea66b-2f02-41dd-ae67-341bc0fe9a59 Jun 06 12:19:10.576670 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-6fdf13d9-11b7-43c3-8e83-b98884f439b4 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action" status: 202 len: 0 microversion: 2.1 time: 0.608671 Jun 06 12:19:10.578758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 577/1124] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:19:09 2022] POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 12:19:10.584418 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-3111095c-f245-4660-8b34-71869e7bc315 req-80ea6ddd-5412-496b-87fb-756eb15576ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:19:10.589752 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:19:10.590773 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:19:10.603920 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:10.604570 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:10.606039 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:10.607665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:10.618963 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3111095c-f245-4660-8b34-71869e7bc315 req-80ea6ddd-5412-496b-87fb-756eb15576ce service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:19:10.619475 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-3111095c-f245-4660-8b34-71869e7bc315 req-80ea6ddd-5412-496b-87fb-756eb15576ce service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:19:10.636780 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-3111095c-f245-4660-8b34-71869e7bc315 req-80ea6ddd-5412-496b-87fb-756eb15576ce service nova] Creating event network-changed:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:19:10.643821 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-3111095c-f245-4660-8b34-71869e7bc315 req-80ea6ddd-5412-496b-87fb-756eb15576ce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065404 Jun 06 12:19:10.645214 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 548/1125] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:19:10.826670 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:19:10.838002 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3eeed614-a13b-4096-828e-c44e57893bda tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1761 microversion: 2.1 time: 0.253213 Jun 06 12:19:10.838925 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 578/1126] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:19:10 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1761 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:08.548152 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:20:08.549250 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:08.551803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=4 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:20:08.559061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:08.559507 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:08.560278 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:08.560707 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:08.641121 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-74fe75ff-7fb5-4c72-a007-5e6b23104a77 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action" status: 202 len: 0 microversion: 2.1 time: 0.097452 Jun 06 12:20:08.644763 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 549/1127] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:20:08 2022] POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:20:08.650795 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:08.651457 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:08.653517 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=5 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:20:08.654416 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=15 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:20:08.660232 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:08.660681 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:08.661569 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:08.661995 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:08.842346 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:08.854270 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-d1a6c853-efa5-4f7a-9e45-68aabecccc7f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1753 microversion: 2.1 time: 0.208125 Jun 06 12:20:08.855536 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 579/1128] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:08 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:09.874953 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:09.875653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:09.881932 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:09.882504 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:09.883954 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:09.884385 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:10.101840 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:10.111263 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-b1fd5059-9802-412b-ba17-377c366f655a tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.241249 Jun 06 12:20:10.111842 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 550/1129] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:09 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:11.129415 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:11.130011 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:11.138755 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:11.139227 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:11.139994 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:11.140421 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:11.302392 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:11.310758 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4707d903-01b3-4f9f-9514-5bc9836319f5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.185280 Jun 06 12:20:11.311364 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 580/1130] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:11 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:12.328330 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:12.329061 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:12.336562 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:12.337011 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:12.337787 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:12.338220 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:12.493803 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:12.501720 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-e81f5b14-6ac0-44df-8d49-197530488f86 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.177200 Jun 06 12:20:12.502287 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 551/1131] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:12 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:13.519153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:13.519770 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:13.527031 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:13.527498 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:13.528261 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:13.528699 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:13.679688 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:13.687730 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-debd8d7c-9319-4157-915f-33b8f2fd82bb tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.172512 Jun 06 12:20:13.688306 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 581/1132] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:13 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:14.705586 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:14.706140 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:14.713580 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:14.714026 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:14.714778 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:14.715308 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:14.865211 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:14.873992 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-c8c0fa8d-0690-4b3f-9ccb-8d2559d86be0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.172313 Jun 06 12:20:14.874571 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 552/1133] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:14 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:15.892242 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:15.892834 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:15.900287 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:15.900740 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:15.901548 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:15.901985 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:16.052391 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:16.061085 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e6504897-78ab-40e7-a431-ca1c5d4b5884 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.172704 Jun 06 12:20:16.061673 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 582/1134] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:15 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:17.078895 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:17.079892 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:17.087270 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:17.088221 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:17.089355 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:17.089948 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:17.240025 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:17.248564 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-880dab44-245d-4b2a-b82a-a25635336bec tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.173480 Jun 06 12:20:17.249145 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 553/1135] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:17 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:18.267015 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:18.267669 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:18.275024 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:18.275470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:18.276238 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:18.276665 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:18.425338 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:18.433865 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-c32438fc-6a38-4278-81ff-8de75f36b924 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.170757 Jun 06 12:20:18.434714 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 583/1136] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:18 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:20:19.450750 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:19.451537 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:19.458368 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:19.458814 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:19.459621 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:19.460054 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:19.607003 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:19.615326 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-132750e4-e5ba-4864-8218-fbd3916344ad tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1758 microversion: 2.1 time: 0.168364 Jun 06 12:20:19.615901 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 554/1137] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:19 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 12:20:20.632481 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:20:20.633098 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:20:20.639954 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:20.640397 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:20.641169 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:20:20.641601 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:20:20.792955 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:20:20.801111 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-b91f04c8-d1ec-4a37-a0cf-599b10ce9c48 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1761 microversion: 2.1 time: 0.172469 Jun 06 12:20:20.801691 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 584/1138] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:20:20 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:20:59.823996 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:20:59.824690 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:21:24.104789 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_api:SELECT=12 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:21:24.105523 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG dbcounter [-] [117630] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:21:24.109417 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1489905196"}} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:21:24.109945 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:24.117136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:24.117578 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:24.118965 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:24.119408 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:24.252119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.network.security_group_api [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Removing security group 9afdcf0c-fcd9-469e-978b-ae56d9f500a2 from port 551ea66b-2f02-41dd-ae67-341bc0fe9a59 Jun 06 12:21:24.638822 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-5e31aad1-45ff-4be0-accf-7a2c638f2ced tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action" status: 202 len: 0 microversion: 2.1 time: 0.535875 Jun 06 12:21:24.640114 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 555/1139] 10.222.0.41 () {60 vars in 1277 bytes} [Mon Jun 6 12:21:24 2022] POST /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:21:24.659146 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-4eedbbe3-039a-4f09-88d3-6fce3bb0d353 req-801b0c7d-7603-4ca3-a9cb-f94cddc55f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:21:24.663622 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_api:SELECT=12 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:21:24.663622 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG dbcounter [-] [117629] Writing DB stats nova_cell1:SELECT=36 {{(pid=117629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 12:21:24.664153 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4eedbbe3-039a-4f09-88d3-6fce3bb0d353 req-801b0c7d-7603-4ca3-a9cb-f94cddc55f97 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:24.664437 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-4eedbbe3-039a-4f09-88d3-6fce3bb0d353 req-801b0c7d-7603-4ca3-a9cb-f94cddc55f97 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:24.682365 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-4eedbbe3-039a-4f09-88d3-6fce3bb0d353 req-801b0c7d-7603-4ca3-a9cb-f94cddc55f97 service nova] Creating event network-changed:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:21:24.690072 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-4eedbbe3-039a-4f09-88d3-6fce3bb0d353 req-801b0c7d-7603-4ca3-a9cb-f94cddc55f97 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046929 Jun 06 12:21:24.691321 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 585/1140] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:21:25.936069 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:25.936653 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:25.943686 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:25.943988 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:25.944906 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:25.945157 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:26.031374 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.objects.instance [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lazy-loading 'services' on Instance uuid 61aa3603-0d6f-4726-aa0b-e3b9379772cb {{(pid=117630) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 12:21:26.113888 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-da603414-35ce-4dea-baac-4929520e3c99 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments/2bb01600-f777-474d-967f-d7495d9596a7" status: 202 len: 0 microversion: 2.1 time: 0.183078 Jun 06 12:21:26.114530 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 556/1141] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:21:25 2022] DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments/2bb01600-f777-474d-967f-d7495d9596a7 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:21:26.127875 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:26.129917 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:26.137650 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:26.138814 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:26.139630 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:26.140201 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:26.173932 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-1d22b4bf-15f5-4dcf-89f1-c310c2693107 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051572 Jun 06 12:21:26.174697 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 586/1142] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:21:26 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:21:26.710018 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [req-49546940-d96c-4e79-bcd1-4241c0dccc79 req-63b2dc67-c3f5-4ece-9089-af98bf59c431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:21:26.722724 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-49546940-d96c-4e79-bcd1-4241c0dccc79 req-63b2dc67-c3f5-4ece-9089-af98bf59c431 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:26.723249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [req-49546940-d96c-4e79-bcd1-4241c0dccc79 req-63b2dc67-c3f5-4ece-9089-af98bf59c431 service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:26.739476 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.compute.server_external_events [req-49546940-d96c-4e79-bcd1-4241c0dccc79 req-63b2dc67-c3f5-4ece-9089-af98bf59c431 service nova] Creating event network-changed:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:21:26.745249 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [req-49546940-d96c-4e79-bcd1-4241c0dccc79 req-63b2dc67-c3f5-4ece-9089-af98bf59c431 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039072 Jun 06 12:21:26.746189 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 557/1143] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:21:27.187810 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:27.191373 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:27.199903 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:27.200858 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:27.202291 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:27.202818 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:27.241263 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-f76806c1-4db0-4079-ad0d-f377575d1bf3 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057641 Jun 06 12:21:27.242003 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 587/1144] 10.222.0.41 () {58 vars in 1301 bytes} [Mon Jun 6 12:21:27 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 12:21:27.254100 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:27.254759 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:27.261872 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:27.262432 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:27.263353 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:27.263894 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:27.345666 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] HTTP exception thrown: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb is not attached to volume 2bb01600-f777-474d-967f-d7495d9596a7 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Request method failure captured: Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments/2bb01600-f777-474d-967f-d7495d9596a7 HTTP/1.1 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABinfCKxoeIY7jSo1gqxOiYbjfigcvqoHoIP4AI0WDW0HEMd_N0ornjkecJyWOs15kxCUeLLi6XYusPagkSmsEAfVn9fqxLLapMHGefPDwTJFRH1bwsXgnHreLoklHevCOT9Nu-LrXTQs4B25_roeLu6QyFx8IAwLYg88KiEnJ7ZyGegCU Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 101a824926d14b078830ace554e9ff3d Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:21:27.348229 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/101a824926d14b078830ace554e9ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_101a824926d14b078830ace554e9ff3d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/101a824926d14b078830ace554e9ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/101a824926d14b078830ace554e9ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 101a824926d14b078830ace554e9ff3d Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-TestMinimumBasicScenario-1073459970-project Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 7c132e34c7e341f9bd753efd38f4fbbd Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestMinimumBasicScenario-1073459970-project Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:21:27.350118 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb is not attached to volume 2bb01600-f777-474d-967f-d7495d9596a7 Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'server_id': '61aa3603-0d6f-4726-aa0b-e3b9379772cb', 'id': '2bb01600-f777-474d-967f-d7495d9596a7'} Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2bb01600-f777-474d-967f-d7495d9596a7. Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:21:27.351212 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb is not attached to volume 2bb01600-f777-474d-967f-d7495d9596a7 Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb is not attached to volume 2bb01600-f777-474d-967f-d7495d9596a7 Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:27.353561 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Returning 404 to user: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb is not attached to volume 2bb01600-f777-474d-967f-d7495d9596a7 {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:21:27.355343 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-a053f4a3-12f6-4ff5-9da3-f622b5632e5e tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments/2bb01600-f777-474d-967f-d7495d9596a7" status: 404 len: 154 microversion: 2.1 time: 0.102970 Jun 06 12:21:27.356023 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 558/1145] 10.222.0.41 () {58 vars in 1415 bytes} [Mon Jun 6 12:21:27 2022] DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb/os-volume_attachments/2bb01600-f777-474d-967f-d7495d9596a7 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:21:28.512881 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:28.513426 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:28.519939 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:28.520387 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:28.521143 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:28.521576 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:28.549064 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Going to try to terminate instance {{(pid=117629) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 12:21:28.632445 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-4bd71d0a-269f-4273-8ea0-5d7ae31b43e0 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 204 len: 0 microversion: 2.1 time: 0.123668 Jun 06 12:21:28.633057 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 588/1146] 10.222.0.41 () {58 vars in 1238 bytes} [Mon Jun 6 12:21:28 2022] DELETE /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 12:21:28.641228 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:28.641845 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:28.649016 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:28.649466 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:28.650693 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:28.651180 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:28.787424 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:21:28.796311 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-2f8c627e-562d-4a19-bb0d-82622120df70 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1555 microversion: 2.1 time: 0.158934 Jun 06 12:21:28.796886 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 559/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:21:28 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:21:29.815260 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:29.815952 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.compute.api [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117629) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:29.823200 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:29.823640 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:29.824394 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:29.824824 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:29.965489 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.policy [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117629) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:21:29.973197 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-e8fc0482-d47b-472d-86a8-d1d20db74632 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1555 microversion: 2.1 time: 0.162181 Jun 06 12:21:29.973778 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 589/1148] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:21:29 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:21:30.990890 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:30.992119 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:31.000748 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:31.001486 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:31.007609 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:31.008362 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:31.082015 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.policy [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c132e34c7e341f9bd753efd38f4fbbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '101a824926d14b078830ace554e9ff3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117630) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 12:21:31.091091 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-45a4b964-b9b0-40ae-b976-54f8750c3c56 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 200 len: 1513 microversion: 2.1 time: 0.104341 Jun 06 12:21:31.091676 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 560/1149] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:21:30 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 1513 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 12:21:31.114207 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [req-6f915955-7a8c-4d19-a943-c0c3baba8c72 req-d7d198c2-e93d-436d-bd2a-aeacdb10ac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61aa3603-0d6f-4726-aa0b-e3b9379772cb", "name": "network-vif-deleted", "tag": "551ea66b-2f02-41dd-ae67-341bc0fe9a59"}]} {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 12:21:31.123020 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6f915955-7a8c-4d19-a943-c0c3baba8c72 req-d7d198c2-e93d-436d-bd2a-aeacdb10ac6a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:31.123470 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG oslo_concurrency.lockutils [req-6f915955-7a8c-4d19-a943-c0c3baba8c72 req-d7d198c2-e93d-436d-bd2a-aeacdb10ac6a service nova] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117629) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:31.134724 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.compute.server_external_events [req-6f915955-7a8c-4d19-a943-c0c3baba8c72 req-d7d198c2-e93d-436d-bd2a-aeacdb10ac6a service nova] Creating event network-vif-deleted:551ea66b-2f02-41dd-ae67-341bc0fe9a59 for instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb on hv-cinder-82549 Jun 06 12:21:31.140249 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [req-6f915955-7a8c-4d19-a943-c0c3baba8c72 req-d7d198c2-e93d-436d-bd2a-aeacdb10ac6a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093862 Jun 06 12:21:31.140976 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 590/1150] 10.222.0.41 () {64 vars in 1317 bytes} [Mon Jun 6 12:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 12:21:32.109021 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '>' {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:32.109638 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.compute.api [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] [instance: 61aa3603-0d6f-4726-aa0b-e3b9379772cb] Fetching instance by UUID {{(pid=117630) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 12:21:32.116078 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:32.116526 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:32.117319 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:21:32.117751 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG oslo_concurrency.lockutils [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Lock "99b97c17-d487-4688-bea3-ee8480699263" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117630) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:21:32.132136 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.wsgi [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] HTTP exception thrown: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Request method failure captured: Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: request: GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb HTTP/1.1 Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept: application/json Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Accept-Encoding: identity Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Connection: close Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Length: 0 Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Content-Type: application/json Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Host: 10.222.0.41 Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Openstack-System-Scope: None Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: User-Agent: python-urllib3/1.26.9 Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Auth-Token: gAAAAABinfCKxoeIY7jSo1gqxOiYbjfigcvqoHoIP4AI0WDW0HEMd_N0ornjkecJyWOs15kxCUeLLi6XYusPagkSmsEAfVn9fqxLLapMHGefPDwTJFRH1bwsXgnHreLoklHevCOT9Nu-LrXTQs4B25_roeLu6QyFx8IAwLYg88KiEnJ7ZyGegCU Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Id: None Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Domain-Name: None Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Identity-Status: Confirmed Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Is-Admin-Project: True Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Id: default Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Domain-Name: Default Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Id: 101a824926d14b078830ace554e9ff3d Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Project-Name: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Role: member,reader Jun 06 12:21:32.133681 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Roles: member,reader Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/101a824926d14b078830ace554e9ff3d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_101a824926d14b078830ace554e9ff3d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/101a824926d14b078830ace554e9ff3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/101a824926d14b078830ace554e9ff3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}] Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Id: 101a824926d14b078830ace554e9ff3d Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1073459970 Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User: tempest-TestMinimumBasicScenario-1073459970-project Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Id: default Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Domain-Name: Default Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Id: 7c132e34c7e341f9bd753efd38f4fbbd Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: X-User-Name: tempest-TestMinimumBasicScenario-1073459970-project Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: method: > Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: exception: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. Jun 06 12:21:32.135538 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: action_args: {'id': '61aa3603-0d6f-4726-aa0b-e3b9379772cb'} Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: {{(pid=117630) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 12:21:32.136572 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. Jun 06 12:21:32.138289 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: ERROR nova.api.openstack.wsgi Jun 06 12:21:32.139943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: DEBUG nova.api.openstack.wsgi [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Returning 404 to user: Instance 61aa3603-0d6f-4726-aa0b-e3b9379772cb could not be found. {{(pid=117630) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 12:21:32.139943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO nova.api.openstack.requestlog [None req-6ed3483a-3a54-4b14-a892-d0dc39b504d5 tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb" status: 404 len: 111 microversion: 2.1 time: 0.030662 Jun 06 12:21:32.139943 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: [pid: 117630|app: 0|req: 561/1151] 10.222.0.41 () {58 vars in 1235 bytes} [Mon Jun 6 12:21:32 2022] GET /compute/v2.1/servers/61aa3603-0d6f-4726-aa0b-e3b9379772cb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 12:21:32.144967 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: DEBUG nova.api.openstack.wsgi [None req-3244853c-fc46-4de4-a5f9-93df8e0d1e3f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] Calling method '.version_select at 0x7fc15be96ee0>' {{(pid=117629) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:21:32.166090 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO nova.api.openstack.requestlog [None req-3244853c-fc46-4de4-a5f9-93df8e0d1e3f tempest-TestMinimumBasicScenario-1073459970 tempest-TestMinimumBasicScenario-1073459970-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1743696444" status: 202 len: 0 microversion: 2.1 time: 0.025645 Jun 06 12:21:32.170179 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: [pid: 117629|app: 0|req: 591/1152] 10.222.0.41 () {58 vars in 1271 bytes} [Mon Jun 6 12:21:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1743696444 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 12:22:22.486560 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:22:22.487241 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:23:44.320275 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:23:44.320914 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:24:03.031057 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:24:03.031636 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:24:03.825557 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:24:03.825846 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:24:19.833853 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:24:19.834482 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:24:21.694851 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:24:21.695556 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:24:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:25:42.495043 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:25:42.495734 dv-cinder-825492-20-iscsi devstack@n-api.service[117630]: Mon Jun 6 12:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 12:27:04.328941 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 12:27:04.329550 dv-cinder-825492-20-iscsi devstack@n-api.service[117629]: Mon Jun 6 12:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!